2023-08-31T00:12:59.808 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T00:12:59.809 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --name pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384998 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384998/orig.config.yaml 2023-08-31T00:12:59.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T00:12:59.987 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384998 branch: wip-batrick-testing-20230830.165602 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7384998' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20230830.165602 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230830.165602 sha1: 833faa571491534dcb6bc6b25a578499081113d8 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6543 sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 sleep_before_teardown: 0 subset: 131/512 suite: fs suite_branch: wip-batrick-testing-20230830.165602 suite_path: /home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 833faa571491534dcb6bc6b25a578499081113d8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f9a8556d5e989d27b6626a0b75ef595991f83d20 timestamp: 2023-08-30_23:48:03 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-08-31T00:12:59.987 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa; will attempt to use it 2023-08-31T00:12:59.988 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa/tasks 2023-08-31T00:12:59.988 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-31T00:12:59.991 INFO:teuthology.task.internal:Checking packages... 2023-08-31T00:13:00.014 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'cc14fc8aa878d09ac353379f17aec3b92248b995' 2023-08-31T00:13:00.015 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-31T00:13:00.015 INFO:teuthology.packaging:ref: None 2023-08-31T00:13:00.015 INFO:teuthology.packaging:tag: None 2023-08-31T00:13:00.016 INFO:teuthology.packaging:branch: wip-batrick-testing-20230830.165602 2023-08-31T00:13:00.016 INFO:teuthology.packaging:sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T00:13:00.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20230830.165602 2023-08-31T00:13:00.235 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5814.gcc14fc8a 2023-08-31T00:13:00.236 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-31T00:13:00.327 INFO:teuthology.task.internal:no buildpackages task found 2023-08-31T00:13:00.328 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-31T00:13:00.337 INFO:teuthology.task.internal:Saving configuration 2023-08-31T00:13:00.355 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-31T00:13:00.367 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T00:13:00.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 00:07:59.803028', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T00:13:00.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 00:07:59.805010', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T00:13:00.415 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-31T00:13:00.428 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-31T00:13:00.428 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-31T00:13:00.428 INFO:teuthology.run_tasks:Running task console_log... 2023-08-31T00:13:00.542 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f27919b6c10>, signals=[15]) 2023-08-31T00:13:00.543 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-31T00:13:00.573 INFO:teuthology.task.internal:Opening connections... 2023-08-31T00:13:00.574 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:13:00.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T00:13:00.647 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:13:00.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T00:13:00.714 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-31T00:13:00.735 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-08-31T00:13:00.756 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-08-31T00:13:00.756 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-08-31T00:13:00.818 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T00:13:00.818 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T00:13:00.819 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2023-08-31T00:13:00.819 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2023-08-31T00:13:00.819 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2023-08-31T00:13:00.819 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2023-08-31T00:13:00.820 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T00:13:00.820 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-08-31T00:13:00.820 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T00:13:00.820 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T00:13:00.820 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T00:13:00.821 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T00:13:00.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:13:00.821 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T00:13:00.821 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T00:13:00.821 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T00:13:00.822 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T00:13:00.822 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-08-31T00:13:00.844 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-08-31T00:13:00.865 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-08-31T00:13:00.865 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-08-31T00:13:00.925 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T00:13:00.925 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T00:13:00.926 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-08-31T00:13:00.926 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-08-31T00:13:00.926 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-08-31T00:13:00.926 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-08-31T00:13:00.927 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T00:13:00.927 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-08-31T00:13:00.927 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T00:13:00.927 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T00:13:00.927 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T00:13:00.928 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T00:13:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:13:00.928 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T00:13:00.928 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T00:13:00.929 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T00:13:00.929 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T00:13:00.929 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-08-31T00:13:00.952 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-31T00:13:00.975 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-31T00:13:00.981 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-31T00:13:00.982 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2023-08-31T00:13:00.984 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2023-08-31T00:13:01.003 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-31T00:13:01.020 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-31T00:13:01.021 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2023-08-31T00:13:01.046 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2023-08-31T00:13:01.072 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-31T00:13:01.135 INFO:teuthology.run_tasks:Running task kernel... 2023-08-31T00:13:01.169 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-31T00:13:01.170 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-31T00:13:01.171 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T00:13:01.172 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T00:13:01.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:13:01.191 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-08-31T00:13:01.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:13:01.193 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2023-08-31T00:13:01.252 INFO:teuthology.orchestra.run.smithi139.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:01.253 INFO:teuthology.task.kernel:Running kernel on smithi139: 4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:01.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2023-08-31T00:13:01.254 INFO:teuthology.orchestra.run.smithi077.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:01.254 INFO:teuthology.task.kernel:Running kernel on smithi077: 4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:01.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2023-08-31T00:13:02.449 INFO:teuthology.orchestra.run.smithi077.stdout:Updating Subscription Management repositories. 2023-08-31T00:13:02.450 INFO:teuthology.orchestra.run.smithi077.stdout:Unable to read consumer identity 2023-08-31T00:13:02.592 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-08-31T00:13:02.593 INFO:teuthology.orchestra.run.smithi139.stdout:Unable to read consumer identity 2023-08-31T00:13:03.922 INFO:teuthology.orchestra.run.smithi077.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-31T00:13:04.098 INFO:teuthology.orchestra.run.smithi139.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-31T00:13:04.598 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-08-31T00:13:05.757 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-08-31T00:13:08.067 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 349 kB/s | 24 kB 00:00 2023-08-31T00:13:08.750 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-31T00:13:08.798 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-08-31T00:13:08.799 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2023-08-31T00:13:08.799 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-08-31T00:13:08.921 DEBUG:teuthology.orchestra.run.smithi077:> echo no | sudo yum reinstall kernel || true 2023-08-31T00:13:09.251 INFO:teuthology.orchestra.run.smithi077.stdout:Updating Subscription Management repositories. 2023-08-31T00:13:09.251 INFO:teuthology.orchestra.run.smithi077.stdout:Unable to read consumer identity 2023-08-31T00:13:09.290 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 417 kB/s | 24 kB 00:00 2023-08-31T00:13:09.515 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:01 ago on Thu 31 Aug 2023 12:13:08 AM UTC. 2023-08-31T00:13:09.555 INFO:teuthology.orchestra.run.smithi077.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T00:13:09.591 INFO:teuthology.orchestra.run.smithi077.stderr:Error: No packages marked for reinstall. 2023-08-31T00:13:09.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum reinstall -y kernel || true 2023-08-31T00:13:09.909 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-31T00:13:09.962 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-08-31T00:13:09.963 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-08-31T00:13:09.963 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-08-31T00:13:09.966 INFO:teuthology.orchestra.run.smithi077.stdout:Updating Subscription Management repositories. 2023-08-31T00:13:09.966 INFO:teuthology.orchestra.run.smithi077.stdout:Unable to read consumer identity 2023-08-31T00:13:10.108 DEBUG:teuthology.orchestra.run.smithi139:> echo no | sudo yum reinstall kernel || true 2023-08-31T00:13:10.221 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 12:13:08 AM UTC. 2023-08-31T00:13:10.263 INFO:teuthology.orchestra.run.smithi077.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T00:13:10.297 INFO:teuthology.orchestra.run.smithi077.stderr:Error: No packages marked for reinstall. 2023-08-31T00:13:10.349 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2023-08-31T00:13:10.429 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:10.429 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:10.430 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-31T00:13:10.430 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-31T00:13:10.431 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-31T00:13:10.440 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-08-31T00:13:10.440 INFO:teuthology.orchestra.run.smithi139.stdout:Unable to read consumer identity 2023-08-31T00:13:10.461 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2023-08-31T00:13:10.474 DEBUG:teuthology.parallel:result is None 2023-08-31T00:13:10.707 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:01 ago on Thu 31 Aug 2023 12:13:09 AM UTC. 2023-08-31T00:13:10.747 INFO:teuthology.orchestra.run.smithi139.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T00:13:10.804 INFO:teuthology.orchestra.run.smithi139.stderr:Error: No packages marked for reinstall. 2023-08-31T00:13:10.851 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum reinstall -y kernel || true 2023-08-31T00:13:11.180 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-08-31T00:13:11.181 INFO:teuthology.orchestra.run.smithi139.stdout:Unable to read consumer identity 2023-08-31T00:13:11.447 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 12:13:09 AM UTC. 2023-08-31T00:13:11.490 INFO:teuthology.orchestra.run.smithi139.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T00:13:11.520 INFO:teuthology.orchestra.run.smithi139.stderr:Error: No packages marked for reinstall. 2023-08-31T00:13:11.571 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2023-08-31T00:13:11.651 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:11.651 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-31T00:13:11.651 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-31T00:13:11.652 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-31T00:13:11.652 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-31T00:13:11.683 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2023-08-31T00:13:11.699 DEBUG:teuthology.parallel:result is None 2023-08-31T00:13:11.700 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-31T00:13:11.743 INFO:teuthology.task.internal:Creating test directory... 2023-08-31T00:13:11.744 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T00:13:11.746 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T00:13:11.764 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-31T00:13:11.788 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-31T00:13:11.794 INFO:teuthology.task.internal:Creating archive directory... 2023-08-31T00:13:11.794 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T00:13:11.806 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T00:13:11.830 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-31T00:13:11.849 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-31T00:13:11.849 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T00:13:11.867 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T00:13:11.895 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T00:13:11.905 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T00:13:11.912 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T00:13:11.923 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T00:13:11.925 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-31T00:13:11.955 INFO:teuthology.task.internal:Configuring sudo... 2023-08-31T00:13:11.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T00:13:11.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T00:13:11.985 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-31T00:13:12.001 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-31T00:13:12.001 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T00:13:12.026 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T00:13:12.043 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T00:13:12.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T00:13:12.180 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T00:13:12.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T00:13:12.306 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:13:12.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T00:13:12.373 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T00:13:12.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T00:13:12.476 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T00:13:12.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T00:13:12.602 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:13:12.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T00:13:12.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2023-08-31T00:13:12.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2023-08-31T00:13:12.751 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T00:13:12.764 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T00:13:13.063 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-31T00:13:13.106 INFO:teuthology.task.internal:Starting timer... 2023-08-31T00:13:13.107 INFO:teuthology.run_tasks:Running task pcp... 2023-08-31T00:13:13.119 INFO:teuthology.run_tasks:Running task selinux... 2023-08-31T00:13:13.131 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-31T00:13:13.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2023-08-31T00:13:13.192 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2023-08-31T00:13:13.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2023-08-31T00:13:13.251 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2023-08-31T00:13:13.253 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-31T00:13:13.253 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2023-08-31T00:13:13.279 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2023-08-31T00:13:13.279 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2023-08-31T00:13:13.304 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2023-08-31T00:13:13.305 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2023-08-31T00:13:13.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T00:13:13.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:13:13.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T00:13:13.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:13:13.376 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-31T00:13:13.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2023-08-31T00:13:13.420 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2023-08-31T00:13:13.449 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-31T00:13:13.530 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-31T00:13:13.535 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-31T00:13:13.668 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-31T00:13:13.685 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-31T00:13:13.686 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-31T00:23:26.998 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2023-08-31T00:23:27.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-08-31T00:23:27.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T00:23:27.071 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-08-31T00:23:27.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-08-31T00:23:27.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-08-31T00:23:27.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T00:23:27.208 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-08-31T00:23:27.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-08-31T00:23:27.278 INFO:teuthology.run_tasks:Running task clock... 2023-08-31T00:23:27.294 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-31T00:23:27.294 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T00:23:27.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T00:23:27.298 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T00:23:27.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T00:23:27.328 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T00:23:27.342 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T00:23:27.348 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T00:23:27.364 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T00:23:27.413 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2023-08-31T00:23:27.425 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2023-08-31T00:23:27.432 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2023-08-31T00:23:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T00:23:27.444 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2023-08-31T00:23:27.452 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T00:23:27.459 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T00:23:27.473 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T00:23:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:bash: ntpq: command not found 2023-08-31T00:23:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T00:23:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2023-08-31T00:23:27.531 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.532 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.540 INFO:teuthology.orchestra.run.smithi139.stderr:bash: ntpq: command not found 2023-08-31T00:23:27.543 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T00:23:27.543 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2023-08-31T00:23:27.543 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.544 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.544 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.544 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T00:23:27.545 INFO:teuthology.run_tasks:Running task install... 2023-08-31T00:23:27.555 DEBUG:teuthology.task.install:project ceph 2023-08-31T00:23:27.555 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}} 2023-08-31T00:23:27.556 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'} 2023-08-31T00:23:27.556 INFO:teuthology.task.install:Using flavor: default 2023-08-31T00:23:27.562 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-31T00:23:27.562 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-31T00:23:27.563 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'tag': None, 'wait_for_package': False} 2023-08-31T00:23:27.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T00:23:27.566 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'tag': None, 'wait_for_package': False} 2023-08-31T00:23:27.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T00:23:27.783 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/ 2023-08-31T00:23:27.783 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5814.gcc14fc8a 2023-08-31T00:23:27.791 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/ 2023-08-31T00:23:27.791 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5814.gcc14fc8a 2023-08-31T00:23:27.892 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T00:23:27.893 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:23:27.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T00:23:27.899 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T00:23:27.900 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:23:27.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T00:23:27.921 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-31T00:23:27.921 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cc14fc8aa878d09ac353379f17aec3b92248b995/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T00:23:27.928 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-31T00:23:27.928 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cc14fc8aa878d09ac353379f17aec3b92248b995/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T00:23:27.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T00:23:27.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T00:23:28.066 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T00:23:28.071 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T00:23:28.133 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2023-08-31T00:23:28.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2023-08-31T00:23:28.136 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2023-08-31T00:23:28.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2023-08-31T00:23:28.503 INFO:teuthology.orchestra.run.smithi077.stdout:Updating Subscription Management repositories. 2023-08-31T00:23:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-08-31T00:23:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:44 files removed 2023-08-31T00:23:29.649 INFO:teuthology.orchestra.run.smithi139.stdout:44 files removed 2023-08-31T00:23:29.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-31T00:23:29.702 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-31T00:23:30.010 INFO:teuthology.orchestra.run.smithi077.stdout:Updating Subscription Management repositories. 2023-08-31T00:23:30.037 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-08-31T00:23:31.302 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 254 kB/s | 81 kB 00:00 2023-08-31T00:23:31.574 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 183 kB/s | 81 kB 00:00 2023-08-31T00:23:31.611 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-08-31T00:23:32.104 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2023-08-31T00:23:32.217 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-08-31T00:23:32.329 INFO:teuthology.orchestra.run.smithi077.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-08-31T00:23:32.501 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-08-31T00:23:32.643 INFO:teuthology.orchestra.run.smithi139.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-08-31T00:23:34.340 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 16 MB 00:01 2023-08-31T00:23:37.780 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 380 kB/s | 24 kB 00:00 2023-08-31T00:23:38.924 INFO:teuthology.orchestra.run.smithi077.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-08-31T00:23:42.368 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 16 MB 00:09 2023-08-31T00:23:45.818 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 365 kB/s | 24 kB 00:00 2023-08-31T00:23:46.953 INFO:teuthology.orchestra.run.smithi139.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-08-31T00:23:47.300 INFO:teuthology.orchestra.run.smithi077.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 47 MB 00:00 2023-08-31T00:23:55.195 INFO:teuthology.orchestra.run.smithi139.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 50 MB/s | 47 MB 00:00 2023-08-31T00:23:58.227 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T00:23:58.228 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T00:23:58.243 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-31T00:23:58.244 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-31T00:23:58.245 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T00:23:58.246 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T00:23:58.249 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T00:23:58.252 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T00:23:58.253 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T00:23:58.390 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-08-31T00:23:58.402 INFO:teuthology.orchestra.run.smithi077.stdout:=========================================================================================================================== 2023-08-31T00:23:58.403 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2023-08-31T00:23:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:=========================================================================================================================== 2023-08-31T00:23:58.403 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2023-08-31T00:23:58.403 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-31T00:23:58.404 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-31T00:23:58.404 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.4 k 2023-08-31T00:23:58.404 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 5.4 M 2023-08-31T00:23:58.404 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 861 k 2023-08-31T00:23:58.404 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 167 k 2023-08-31T00:23:58.405 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 1.6 M 2023-08-31T00:23:58.405 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 132 k 2023-08-31T00:23:58.405 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 1.7 M 2023-08-31T00:23:58.405 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 7.4 M 2023-08-31T00:23:58.406 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 47 k 2023-08-31T00:23:58.406 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 14 M 2023-08-31T00:23:58.406 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 48 M 2023-08-31T00:23:58.406 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 261 k 2023-08-31T00:23:58.407 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 171 k 2023-08-31T00:23:58.407 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 260 k 2023-08-31T00:23:58.407 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 18 k 2023-08-31T00:23:58.407 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-31T00:23:58.407 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-31T00:23:58.408 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-31T00:23:58.408 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 31 k 2023-08-31T00:23:58.408 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 784 k 2023-08-31T00:23:58.408 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T00:23:58.409 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-31T00:23:58.409 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-31T00:23:58.409 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-31T00:23:58.410 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-31T00:23:58.410 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-31T00:23:58.410 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-31T00:23:58.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 196 k 2023-08-31T00:23:58.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 370 k 2023-08-31T00:23:58.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 364 k 2023-08-31T00:23:58.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 107 k 2023-08-31T00:23:58.412 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 94 k 2023-08-31T00:23:58.413 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.5 M 2023-08-31T00:23:58.413 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 179 k 2023-08-31T00:23:58.413 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-31T00:23:58.414 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2023-08-31T00:23:58.414 INFO:teuthology.orchestra.run.smithi077.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-31T00:23:58.414 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.7 M 2023-08-31T00:23:58.415 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.6 M 2023-08-31T00:23:58.415 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2023-08-31T00:23:58.415 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-31T00:23:58.416 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 22 M 2023-08-31T00:23:58.416 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 23 k 2023-08-31T00:23:58.416 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 2.3 M 2023-08-31T00:23:58.417 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 242 k 2023-08-31T00:23:58.417 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 4.6 M 2023-08-31T00:23:58.418 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 18 M 2023-08-31T00:23:58.418 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 15 k 2023-08-31T00:23:58.418 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 24 k 2023-08-31T00:23:58.419 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-31T00:23:58.419 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T00:23:58.419 INFO:teuthology.orchestra.run.smithi077.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-31T00:23:58.420 INFO:teuthology.orchestra.run.smithi077.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-31T00:23:58.420 INFO:teuthology.orchestra.run.smithi077.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-31T00:23:58.421 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T00:23:58.421 INFO:teuthology.orchestra.run.smithi077.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-31T00:23:58.421 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-31T00:23:58.422 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T00:23:58.422 INFO:teuthology.orchestra.run.smithi077.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-31T00:23:58.423 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-31T00:23:58.423 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-31T00:23:58.423 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 472 k 2023-08-31T00:23:58.424 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-31T00:23:58.424 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.8 M 2023-08-31T00:23:58.424 INFO:teuthology.orchestra.run.smithi077.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-31T00:23:58.425 INFO:teuthology.orchestra.run.smithi077.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-31T00:23:58.425 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T00:23:58.425 INFO:teuthology.orchestra.run.smithi077.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-31T00:23:58.426 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-31T00:23:58.426 INFO:teuthology.orchestra.run.smithi077.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-31T00:23:58.427 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-31T00:23:58.427 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-31T00:23:58.427 INFO:teuthology.orchestra.run.smithi077.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-31T00:23:58.428 INFO:teuthology.orchestra.run.smithi077.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-31T00:23:58.428 INFO:teuthology.orchestra.run.smithi077.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-31T00:23:58.428 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-31T00:23:58.428 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-31T00:23:58.429 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T00:23:58.429 INFO:teuthology.orchestra.run.smithi077.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T00:23:58.429 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T00:23:58.430 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 45 k 2023-08-31T00:23:58.430 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 125 k 2023-08-31T00:23:58.430 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T00:23:58.430 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-31T00:23:58.431 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T00:23:58.431 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T00:23:58.431 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-31T00:23:58.432 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T00:23:58.432 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T00:23:58.432 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T00:23:58.432 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T00:23:58.432 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-31T00:23:58.433 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-31T00:23:58.433 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T00:23:58.433 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T00:23:58.433 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T00:23:58.433 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-31T00:23:58.434 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-31T00:23:58.434 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T00:23:58.435 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-31T00:23:58.435 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-31T00:23:58.435 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-31T00:23:58.435 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-31T00:23:58.435 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T00:23:58.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T00:23:58.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-31T00:23:58.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-31T00:23:58.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-31T00:23:58.436 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-31T00:23:58.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-31T00:23:58.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-31T00:23:58.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T00:23:58.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T00:23:58.437 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T00:23:58.438 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T00:23:58.438 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-31T00:23:58.438 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T00:23:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T00:23:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T00:23:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T00:23:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T00:23:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T00:23:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T00:23:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T00:23:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-31T00:23:58.441 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T00:23:58.441 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-31T00:23:58.441 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-31T00:23:58.441 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-31T00:23:58.442 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-31T00:23:58.442 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-31T00:23:58.442 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling module streams: 2023-08-31T00:23:58.442 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql 10 2023-08-31T00:23:58.443 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:23:58.443 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2023-08-31T00:23:58.443 INFO:teuthology.orchestra.run.smithi077.stdout:=========================================================================================================================== 2023-08-31T00:23:58.444 INFO:teuthology.orchestra.run.smithi077.stdout:Install 128 Packages 2023-08-31T00:23:58.444 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 3 Packages 2023-08-31T00:23:58.444 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:23:58.445 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 206 M 2023-08-31T00:23:58.445 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2023-08-31T00:23:58.910 INFO:teuthology.orchestra.run.smithi077.stdout:(1/131): ceph-18.0.0-5814.gcc14fc8a.el8.x86_64. 36 kB/s | 6.4 kB 00:00 2023-08-31T00:23:59.284 INFO:teuthology.orchestra.run.smithi077.stdout:(2/131): ceph-base-18.0.0-5814.gcc14fc8a.el8.x8 9.7 MB/s | 5.4 MB 00:00 2023-08-31T00:23:59.342 INFO:teuthology.orchestra.run.smithi077.stdout:(3/131): ceph-immutable-object-cache-18.0.0-581 2.8 MB/s | 167 kB 00:00 2023-08-31T00:23:59.509 INFO:teuthology.orchestra.run.smithi077.stdout:(4/131): ceph-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.4 MB/s | 861 kB 00:00 2023-08-31T00:23:59.560 INFO:teuthology.orchestra.run.smithi077.stdout:(5/131): ceph-mds-18.0.0-5814.gcc14fc8a.el8.x86 11 MB/s | 2.3 MB 00:00 2023-08-31T00:23:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:(6/131): ceph-mon-18.0.0-5814.gcc14fc8a.el8.x86 13 MB/s | 4.6 MB 00:00 2023-08-31T00:24:00.493 INFO:teuthology.orchestra.run.smithi077.stdout:(7/131): ceph-mgr-18.0.0-5814.gcc14fc8a.el8.x86 1.6 MB/s | 1.6 MB 00:00 2023-08-31T00:24:00.760 INFO:teuthology.orchestra.run.smithi077.stdout:(8/131): ceph-common-18.0.0-5814.gcc14fc8a.el8. 11 MB/s | 22 MB 00:02 2023-08-31T00:24:00.811 INFO:teuthology.orchestra.run.smithi077.stdout:(9/131): ceph-selinux-18.0.0-5814.gcc14fc8a.el8 488 kB/s | 24 kB 00:00 2023-08-31T00:24:01.269 INFO:teuthology.orchestra.run.smithi077.stdout:(10/131): ceph-osd-18.0.0-5814.gcc14fc8a.el8.x8 13 MB/s | 18 MB 00:01 2023-08-31T00:24:01.337 INFO:teuthology.orchestra.run.smithi077.stdout:(11/131): cephfs-mirror-18.0.0-5814.gcc14fc8a.e 3.8 MB/s | 260 kB 00:00 2023-08-31T00:24:01.404 INFO:teuthology.orchestra.run.smithi077.stdout:(12/131): libcephfs-devel-18.0.0-5814.gcc14fc8a 467 kB/s | 31 kB 00:00 2023-08-31T00:24:01.504 INFO:teuthology.orchestra.run.smithi077.stdout:(13/131): libcephfs2-18.0.0-5814.gcc14fc8a.el8. 7.7 MB/s | 784 kB 00:00 2023-08-31T00:24:01.570 INFO:teuthology.orchestra.run.smithi077.stdout:(14/131): libcephsqlite-18.0.0-5814.gcc14fc8a.e 2.0 MB/s | 139 kB 00:00 2023-08-31T00:24:01.637 INFO:teuthology.orchestra.run.smithi077.stdout:(15/131): librados-devel-18.0.0-5814.gcc14fc8a. 2.0 MB/s | 139 kB 00:00 2023-08-31T00:24:01.721 INFO:teuthology.orchestra.run.smithi077.stdout:(16/131): libradosstriper1-18.0.0-5814.gcc14fc8 5.5 MB/s | 472 kB 00:00 2023-08-31T00:24:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:(17/131): librgw2-18.0.0-5814.gcc14fc8a.el8.x86 11 MB/s | 6.8 MB 00:00 2023-08-31T00:24:02.372 INFO:teuthology.orchestra.run.smithi077.stdout:(18/131): python3-ceph-argparse-18.0.0-5814.gcc 769 kB/s | 45 kB 00:00 2023-08-31T00:24:02.447 INFO:teuthology.orchestra.run.smithi077.stdout:(19/131): python3-ceph-common-18.0.0-5814.gcc14 1.6 MB/s | 125 kB 00:00 2023-08-31T00:24:02.522 INFO:teuthology.orchestra.run.smithi077.stdout:(20/131): python3-cephfs-18.0.0-5814.gcc14fc8a. 2.6 MB/s | 196 kB 00:00 2023-08-31T00:24:02.614 INFO:teuthology.orchestra.run.smithi077.stdout:(21/131): python3-rados-18.0.0-5814.gcc14fc8a.e 3.9 MB/s | 370 kB 00:00 2023-08-31T00:24:02.689 INFO:teuthology.orchestra.run.smithi077.stdout:(22/131): python3-rbd-18.0.0-5814.gcc14fc8a.el8 4.8 MB/s | 364 kB 00:00 2023-08-31T00:24:02.756 INFO:teuthology.orchestra.run.smithi077.stdout:(23/131): python3-rgw-18.0.0-5814.gcc14fc8a.el8 1.6 MB/s | 107 kB 00:00 2023-08-31T00:24:02.823 INFO:teuthology.orchestra.run.smithi077.stdout:(24/131): rbd-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.4 MB/s | 94 kB 00:00 2023-08-31T00:24:03.160 INFO:teuthology.orchestra.run.smithi077.stdout:(25/131): rbd-mirror-18.0.0-5814.gcc14fc8a.el8. 10 MB/s | 3.5 MB 00:00 2023-08-31T00:24:03.232 INFO:teuthology.orchestra.run.smithi077.stdout:(26/131): rbd-nbd-18.0.0-5814.gcc14fc8a.el8.x86 2.4 MB/s | 179 kB 00:00 2023-08-31T00:24:03.291 INFO:teuthology.orchestra.run.smithi077.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5814.g 396 kB/s | 23 kB 00:00 2023-08-31T00:24:03.357 INFO:teuthology.orchestra.run.smithi077.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5814.gcc14fc8 1.9 MB/s | 132 kB 00:00 2023-08-31T00:24:03.875 INFO:teuthology.orchestra.run.smithi077.stdout:(29/131): ceph-test-18.0.0-5814.gcc14fc8a.el8.x 16 MB/s | 48 MB 00:03 2023-08-31T00:24:03.942 INFO:teuthology.orchestra.run.smithi077.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5814.gcc14f 3.0 MB/s | 1.7 MB 00:00 2023-08-31T00:24:04.017 INFO:teuthology.orchestra.run.smithi077.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5814.gcc 3.2 MB/s | 242 kB 00:00 2023-08-31T00:24:04.084 INFO:teuthology.orchestra.run.smithi077.stdout:(32/131): ceph-mgr-rook-18.0.0-5814.gcc14fc8a.e 713 kB/s | 47 kB 00:00 2023-08-31T00:24:04.151 INFO:teuthology.orchestra.run.smithi077.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5814.gc 218 kB/s | 15 kB 00:00 2023-08-31T00:24:04.209 INFO:teuthology.orchestra.run.smithi077.stdout:(34/131): ceph-volume-18.0.0-5814.gcc14fc8a.el8 4.4 MB/s | 261 kB 00:00 2023-08-31T00:24:04.343 INFO:teuthology.orchestra.run.smithi077.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 16 MB/s | 7.4 MB 00:00 2023-08-31T00:24:04.368 INFO:teuthology.orchestra.run.smithi077.stdout:(36/131): cephadm-18.0.0-5814.gcc14fc8a.el8.noa 1.1 MB/s | 171 kB 00:00 2023-08-31T00:24:04.385 INFO:teuthology.orchestra.run.smithi077.stdout:(37/131): cephfs-top-18.0.0-5814.gcc14fc8a.el8. 431 kB/s | 18 kB 00:00 2023-08-31T00:24:04.944 INFO:teuthology.orchestra.run.smithi077.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 105 kB/s | 59 kB 00:00 2023-08-31T00:24:05.102 INFO:teuthology.orchestra.run.smithi077.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 474 kB/s | 75 kB 00:00 2023-08-31T00:24:05.179 INFO:teuthology.orchestra.run.smithi077.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 378 kB/s | 306 kB 00:00 2023-08-31T00:24:05.279 INFO:teuthology.orchestra.run.smithi077.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 440 kB/s | 44 kB 00:00 2023-08-31T00:24:05.429 INFO:teuthology.orchestra.run.smithi077.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2023-08-31T00:24:05.462 INFO:teuthology.orchestra.run.smithi077.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2023-08-31T00:24:05.588 INFO:teuthology.orchestra.run.smithi077.stdout:(44/131): ceph-radosgw-18.0.0-5814.gcc14fc8a.el 2.7 MB/s | 14 MB 00:05 2023-08-31T00:24:05.613 INFO:teuthology.orchestra.run.smithi077.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 108 kB/s | 16 kB 00:00 2023-08-31T00:24:05.638 INFO:teuthology.orchestra.run.smithi077.stdout:(46/131): python3-cachetools-3.1.1-4.el8.noarch 158 kB/s | 33 kB 00:00 2023-08-31T00:24:05.747 INFO:teuthology.orchestra.run.smithi077.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 749 kB/s | 81 kB 00:00 2023-08-31T00:24:05.815 INFO:teuthology.orchestra.run.smithi077.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-08-31T00:24:05.857 INFO:teuthology.orchestra.run.smithi077.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2023-08-31T00:24:05.914 INFO:teuthology.orchestra.run.smithi077.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 178 kB/s | 18 kB 00:00 2023-08-31T00:24:05.998 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T00:24:05.999 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T00:24:06.013 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-31T00:24:06.014 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-31T00:24:06.015 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T00:24:06.016 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T00:24:06.018 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T00:24:06.021 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T00:24:06.023 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T00:24:06.023 INFO:teuthology.orchestra.run.smithi077.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 449 kB/s | 49 kB 00:00 2023-08-31T00:24:06.090 INFO:teuthology.orchestra.run.smithi077.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-08-31T00:24:06.107 INFO:teuthology.orchestra.run.smithi077.stdout:(53/131): python3-cheroot-8.5.2-1.el8.noarch.rp 333 kB/s | 173 kB 00:00 2023-08-31T00:24:06.132 INFO:teuthology.orchestra.run.smithi077.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2023-08-31T00:24:06.154 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-08-31T00:24:06.167 INFO:teuthology.orchestra.run.smithi139.stdout:=========================================================================================================================== 2023-08-31T00:24:06.167 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-08-31T00:24:06.167 INFO:teuthology.orchestra.run.smithi139.stdout:=========================================================================================================================== 2023-08-31T00:24:06.167 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-08-31T00:24:06.168 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-31T00:24:06.168 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-31T00:24:06.168 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.4 k 2023-08-31T00:24:06.168 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 5.4 M 2023-08-31T00:24:06.168 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 861 k 2023-08-31T00:24:06.169 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 167 k 2023-08-31T00:24:06.169 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 1.6 M 2023-08-31T00:24:06.169 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 132 k 2023-08-31T00:24:06.169 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 1.7 M 2023-08-31T00:24:06.169 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 7.4 M 2023-08-31T00:24:06.169 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 47 k 2023-08-31T00:24:06.170 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 14 M 2023-08-31T00:24:06.170 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 48 M 2023-08-31T00:24:06.170 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 261 k 2023-08-31T00:24:06.171 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 171 k 2023-08-31T00:24:06.171 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 260 k 2023-08-31T00:24:06.171 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 18 k 2023-08-31T00:24:06.171 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-31T00:24:06.172 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-31T00:24:06.172 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-31T00:24:06.172 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 31 k 2023-08-31T00:24:06.173 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 784 k 2023-08-31T00:24:06.173 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T00:24:06.173 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-31T00:24:06.174 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-31T00:24:06.174 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-31T00:24:06.174 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-31T00:24:06.174 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-31T00:24:06.175 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-31T00:24:06.175 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 196 k 2023-08-31T00:24:06.175 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 370 k 2023-08-31T00:24:06.176 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 364 k 2023-08-31T00:24:06.176 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 107 k 2023-08-31T00:24:06.176 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 94 k 2023-08-31T00:24:06.176 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.5 M 2023-08-31T00:24:06.177 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 179 k 2023-08-31T00:24:06.177 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-31T00:24:06.177 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2023-08-31T00:24:06.178 INFO:teuthology.orchestra.run.smithi139.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-31T00:24:06.179 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.7 M 2023-08-31T00:24:06.180 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.6 M 2023-08-31T00:24:06.180 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-08-31T00:24:06.180 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-31T00:24:06.180 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 22 M 2023-08-31T00:24:06.180 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 23 k 2023-08-31T00:24:06.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 2.3 M 2023-08-31T00:24:06.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 242 k 2023-08-31T00:24:06.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 4.6 M 2023-08-31T00:24:06.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 18 M 2023-08-31T00:24:06.181 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 15 k 2023-08-31T00:24:06.182 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 24 k 2023-08-31T00:24:06.182 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-31T00:24:06.182 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T00:24:06.182 INFO:teuthology.orchestra.run.smithi139.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-31T00:24:06.183 INFO:teuthology.orchestra.run.smithi139.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-31T00:24:06.183 INFO:teuthology.orchestra.run.smithi139.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-31T00:24:06.183 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T00:24:06.183 INFO:teuthology.orchestra.run.smithi139.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-31T00:24:06.184 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-31T00:24:06.184 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T00:24:06.184 INFO:teuthology.orchestra.run.smithi139.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-31T00:24:06.185 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-31T00:24:06.185 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-31T00:24:06.185 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 472 k 2023-08-31T00:24:06.186 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-31T00:24:06.186 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.8 M 2023-08-31T00:24:06.186 INFO:teuthology.orchestra.run.smithi139.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-31T00:24:06.187 INFO:teuthology.orchestra.run.smithi139.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-31T00:24:06.187 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T00:24:06.187 INFO:teuthology.orchestra.run.smithi139.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-31T00:24:06.187 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-31T00:24:06.188 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-31T00:24:06.188 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-31T00:24:06.188 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-31T00:24:06.188 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-31T00:24:06.189 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-31T00:24:06.189 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-31T00:24:06.189 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-31T00:24:06.190 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-31T00:24:06.190 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T00:24:06.190 INFO:teuthology.orchestra.run.smithi139.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T00:24:06.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T00:24:06.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 45 k 2023-08-31T00:24:06.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 125 k 2023-08-31T00:24:06.191 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T00:24:06.192 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-31T00:24:06.192 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T00:24:06.192 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T00:24:06.193 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-31T00:24:06.193 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T00:24:06.193 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T00:24:06.194 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T00:24:06.194 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T00:24:06.194 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-31T00:24:06.194 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-31T00:24:06.195 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T00:24:06.195 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T00:24:06.196 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T00:24:06.196 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-31T00:24:06.196 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-31T00:24:06.197 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T00:24:06.197 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-31T00:24:06.197 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-31T00:24:06.198 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-31T00:24:06.198 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-31T00:24:06.198 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T00:24:06.198 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T00:24:06.199 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-31T00:24:06.199 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-31T00:24:06.199 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-31T00:24:06.200 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-31T00:24:06.200 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-31T00:24:06.200 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-31T00:24:06.201 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T00:24:06.201 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T00:24:06.201 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T00:24:06.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T00:24:06.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-31T00:24:06.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T00:24:06.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T00:24:06.203 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T00:24:06.203 INFO:teuthology.orchestra.run.smithi139.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T00:24:06.203 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T00:24:06.204 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T00:24:06.204 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T00:24:06.204 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T00:24:06.205 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-31T00:24:06.205 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T00:24:06.205 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-31T00:24:06.206 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-31T00:24:06.206 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-31T00:24:06.206 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-31T00:24:06.207 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-31T00:24:06.207 INFO:teuthology.orchestra.run.smithi139.stdout:Enabling module streams: 2023-08-31T00:24:06.207 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql 10 2023-08-31T00:24:06.207 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:24:06.207 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-08-31T00:24:06.208 INFO:teuthology.orchestra.run.smithi139.stdout:=========================================================================================================================== 2023-08-31T00:24:06.208 INFO:teuthology.orchestra.run.smithi139.stdout:Install 128 Packages 2023-08-31T00:24:06.208 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 3 Packages 2023-08-31T00:24:06.208 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:24:06.209 INFO:teuthology.orchestra.run.smithi077.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 515 kB/s | 60 kB 00:00 2023-08-31T00:24:06.209 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 206 M 2023-08-31T00:24:06.210 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-08-31T00:24:06.232 INFO:teuthology.orchestra.run.smithi077.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-08-31T00:24:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-08-31T00:24:06.333 INFO:teuthology.orchestra.run.smithi077.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-08-31T00:24:06.358 INFO:teuthology.orchestra.run.smithi077.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-08-31T00:24:06.409 INFO:teuthology.orchestra.run.smithi077.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 640 kB/s | 64 kB 00:00 2023-08-31T00:24:06.434 INFO:teuthology.orchestra.run.smithi077.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-08-31T00:24:06.459 INFO:teuthology.orchestra.run.smithi077.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-08-31T00:24:06.509 INFO:teuthology.orchestra.run.smithi077.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2023-08-31T00:24:06.560 INFO:teuthology.orchestra.run.smithi077.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2023-08-31T00:24:06.596 INFO:teuthology.orchestra.run.smithi077.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-08-31T00:24:06.618 INFO:teuthology.orchestra.run.smithi077.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-08-31T00:24:06.669 INFO:teuthology.orchestra.run.smithi077.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 562 kB/s | 61 kB 00:00 2023-08-31T00:24:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 786 kB/s | 85 kB 00:00 2023-08-31T00:24:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2023-08-31T00:24:06.744 INFO:teuthology.orchestra.run.smithi139.stdout:(1/131): ceph-18.0.0-5814.gcc14fc8a.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-08-31T00:24:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-08-31T00:24:06.937 INFO:teuthology.orchestra.run.smithi077.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 225 kB/s | 47 kB 00:00 2023-08-31T00:24:06.962 INFO:teuthology.orchestra.run.smithi077.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 986 kB/s | 200 kB 00:00 2023-08-31T00:24:06.996 INFO:teuthology.orchestra.run.smithi077.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2023-08-31T00:24:07.063 INFO:teuthology.orchestra.run.smithi077.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 340 kB/s | 43 kB 00:00 2023-08-31T00:24:07.154 INFO:teuthology.orchestra.run.smithi077.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 303 kB/s | 48 kB 00:00 2023-08-31T00:24:07.180 INFO:teuthology.orchestra.run.smithi077.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-08-31T00:24:07.297 INFO:teuthology.orchestra.run.smithi077.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 372 kB/s | 87 kB 00:00 2023-08-31T00:24:07.322 INFO:teuthology.orchestra.run.smithi077.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 255 kB/s | 43 kB 00:00 2023-08-31T00:24:07.347 INFO:teuthology.orchestra.run.smithi077.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 653 kB/s | 109 kB 00:00 2023-08-31T00:24:07.397 INFO:teuthology.orchestra.run.smithi077.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-08-31T00:24:07.514 INFO:teuthology.orchestra.run.smithi077.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.8 MB/s | 560 kB 00:00 2023-08-31T00:24:07.556 INFO:teuthology.orchestra.run.smithi077.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 89 kB/s | 19 kB 00:00 2023-08-31T00:24:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 806 kB/s | 155 kB 00:00 2023-08-31T00:24:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 143 kB/s | 18 kB 00:00 2023-08-31T00:24:07.691 INFO:teuthology.orchestra.run.smithi139.stdout:(2/131): ceph-fuse-18.0.0-5814.gcc14fc8a.el8.x8 910 kB/s | 861 kB 00:00 2023-08-31T00:24:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-08-31T00:24:07.766 INFO:teuthology.orchestra.run.smithi077.stdout:(86/131): python3-cryptography-3.2.1-5.el8.x86_ 2.2 MB/s | 559 kB 00:00 2023-08-31T00:24:07.816 INFO:teuthology.orchestra.run.smithi077.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-08-31T00:24:07.883 INFO:teuthology.orchestra.run.smithi077.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 14 MB/s | 2.3 MB 00:00 2023-08-31T00:24:07.900 INFO:teuthology.orchestra.run.smithi077.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 540 kB/s | 72 kB 00:00 2023-08-31T00:24:07.950 INFO:teuthology.orchestra.run.smithi077.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 618 kB/s | 83 kB 00:00 2023-08-31T00:24:07.970 INFO:teuthology.orchestra.run.smithi139.stdout:(3/131): ceph-common-18.0.0-5814.gcc14fc8a.el8. 16 MB/s | 22 MB 00:01 2023-08-31T00:24:07.992 INFO:teuthology.orchestra.run.smithi077.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.0 MB/s | 98 kB 00:00 2023-08-31T00:24:07.995 INFO:teuthology.orchestra.run.smithi139.stdout:(4/131): ceph-immutable-object-cache-18.0.0-581 550 kB/s | 167 kB 00:00 2023-08-31T00:24:08.042 INFO:teuthology.orchestra.run.smithi077.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 628 kB/s | 58 kB 00:00 2023-08-31T00:24:08.062 INFO:teuthology.orchestra.run.smithi139.stdout:(5/131): ceph-base-18.0.0-5814.gcc14fc8a.el8.x8 3.6 MB/s | 5.4 MB 00:01 2023-08-31T00:24:08.067 INFO:teuthology.orchestra.run.smithi077.stdout:(93/131): elfutils-libelf-devel-0.186-1.el8.x86 325 kB/s | 60 kB 00:00 2023-08-31T00:24:08.101 INFO:teuthology.orchestra.run.smithi077.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 355 kB/s | 39 kB 00:00 2023-08-31T00:24:08.121 INFO:teuthology.orchestra.run.smithi139.stdout:(6/131): ceph-mds-18.0.0-5814.gcc14fc8a.el8.x86 15 MB/s | 2.3 MB 00:00 2023-08-31T00:24:08.168 INFO:teuthology.orchestra.run.smithi077.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.7 MB/s | 171 kB 00:00 2023-08-31T00:24:08.210 INFO:teuthology.orchestra.run.smithi077.stdout:(96/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.8 MB/s | 644 kB 00:00 2023-08-31T00:24:08.252 INFO:teuthology.orchestra.run.smithi077.stdout:(97/131): NetworkManager-initscripts-updown-1.3 915 kB/s | 138 kB 00:00 2023-08-31T00:24:08.388 INFO:teuthology.orchestra.run.smithi077.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 621 kB/s | 110 kB 00:00 2023-08-31T00:24:08.419 INFO:teuthology.orchestra.run.smithi077.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 324 kB/s | 54 kB 00:00 2023-08-31T00:24:08.495 INFO:teuthology.orchestra.run.smithi077.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.4 MB/s | 259 kB 00:00 2023-08-31T00:24:08.553 INFO:teuthology.orchestra.run.smithi077.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-08-31T00:24:08.728 INFO:teuthology.orchestra.run.smithi077.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 24 MB/s | 14 MB 00:00 2023-08-31T00:24:08.795 INFO:teuthology.orchestra.run.smithi077.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 129 kB/s | 39 kB 00:00 2023-08-31T00:24:08.829 INFO:teuthology.orchestra.run.smithi139.stdout:(7/131): ceph-mgr-18.0.0-5814.gcc14fc8a.el8.x86 1.9 MB/s | 1.6 MB 00:00 2023-08-31T00:24:08.837 INFO:teuthology.orchestra.run.smithi077.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2023-08-31T00:24:08.896 INFO:teuthology.orchestra.run.smithi077.stdout:(105/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.1 MB/s | 538 kB 00:00 2023-08-31T00:24:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:(106/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-08-31T00:24:08.938 INFO:teuthology.orchestra.run.smithi077.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-08-31T00:24:09.013 INFO:teuthology.orchestra.run.smithi077.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 6.0 MB/s | 713 kB 00:00 2023-08-31T00:24:09.130 INFO:teuthology.orchestra.run.smithi139.stdout:(8/131): ceph-osd-18.0.0-5814.gcc14fc8a.el8.x86 18 MB/s | 18 MB 00:01 2023-08-31T00:24:09.197 INFO:teuthology.orchestra.run.smithi139.stdout:(9/131): ceph-mon-18.0.0-5814.gcc14fc8a.el8.x86 4.1 MB/s | 4.6 MB 00:01 2023-08-31T00:24:09.213 INFO:teuthology.orchestra.run.smithi139.stdout:(10/131): ceph-selinux-18.0.0-5814.gcc14fc8a.el 292 kB/s | 24 kB 00:00 2023-08-31T00:24:09.222 INFO:teuthology.orchestra.run.smithi077.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-08-31T00:24:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 86 kB/s | 27 kB 00:00 2023-08-31T00:24:09.266 INFO:teuthology.orchestra.run.smithi139.stdout:(11/131): cephfs-mirror-18.0.0-5814.gcc14fc8a.e 5.1 MB/s | 260 kB 00:00 2023-08-31T00:24:09.272 INFO:teuthology.orchestra.run.smithi077.stdout:(111/131): flex-2.6.1-9.el8.x86_64.rpm 1.2 MB/s | 320 kB 00:00 2023-08-31T00:24:09.297 INFO:teuthology.orchestra.run.smithi139.stdout:(12/131): libcephfs-devel-18.0.0-5814.gcc14fc8a 933 kB/s | 31 kB 00:00 2023-08-31T00:24:09.306 INFO:teuthology.orchestra.run.smithi077.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 526 kB/s | 44 kB 00:00 2023-08-31T00:24:09.365 INFO:teuthology.orchestra.run.smithi077.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 4.9 MB/s | 457 kB 00:00 2023-08-31T00:24:09.411 INFO:teuthology.orchestra.run.smithi139.stdout:(13/131): libcephfs2-18.0.0-5814.gcc14fc8a.el8. 6.8 MB/s | 784 kB 00:00 2023-08-31T00:24:09.448 INFO:teuthology.orchestra.run.smithi077.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2023-08-31T00:24:09.464 INFO:teuthology.orchestra.run.smithi139.stdout:(14/131): libcephsqlite-18.0.0-5814.gcc14fc8a.e 2.5 MB/s | 139 kB 00:00 2023-08-31T00:24:09.524 INFO:teuthology.orchestra.run.smithi077.stdout:(115/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-08-31T00:24:09.532 INFO:teuthology.orchestra.run.smithi139.stdout:(15/131): librados-devel-18.0.0-5814.gcc14fc8a. 2.0 MB/s | 139 kB 00:00 2023-08-31T00:24:09.549 INFO:teuthology.orchestra.run.smithi077.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 348 kB/s | 64 kB 00:00 2023-08-31T00:24:09.574 INFO:teuthology.orchestra.run.smithi077.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.0 MB/s | 126 kB 00:00 2023-08-31T00:24:09.599 INFO:teuthology.orchestra.run.smithi139.stdout:(16/131): libradosstriper1-18.0.0-5814.gcc14fc8 6.9 MB/s | 472 kB 00:00 2023-08-31T00:24:09.683 INFO:teuthology.orchestra.run.smithi077.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 126 kB/s | 20 kB 00:00 2023-08-31T00:24:09.708 INFO:teuthology.orchestra.run.smithi077.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 652 kB/s | 103 kB 00:00 2023-08-31T00:24:09.750 INFO:teuthology.orchestra.run.smithi077.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2023-08-31T00:24:09.808 INFO:teuthology.orchestra.run.smithi077.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-08-31T00:24:09.926 INFO:teuthology.orchestra.run.smithi077.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 20 MB/s | 4.9 MB 00:00 2023-08-31T00:24:09.952 INFO:teuthology.orchestra.run.smithi077.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-08-31T00:24:09.993 INFO:teuthology.orchestra.run.smithi077.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2023-08-31T00:24:10.066 INFO:teuthology.orchestra.run.smithi139.stdout:(17/131): librgw2-18.0.0-5814.gcc14fc8a.el8.x86 15 MB/s | 6.8 MB 00:00 2023-08-31T00:24:10.084 INFO:teuthology.orchestra.run.smithi077.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-08-31T00:24:10.141 INFO:teuthology.orchestra.run.smithi139.stdout:(18/131): python3-ceph-argparse-18.0.0-5814.gcc 599 kB/s | 45 kB 00:00 2023-08-31T00:24:10.143 INFO:teuthology.orchestra.run.smithi077.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.3 MB/s | 808 kB 00:00 2023-08-31T00:24:10.200 INFO:teuthology.orchestra.run.smithi139.stdout:(19/131): python3-ceph-common-18.0.0-5814.gcc14 2.1 MB/s | 125 kB 00:00 2023-08-31T00:24:10.260 INFO:teuthology.orchestra.run.smithi077.stdout:(127/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-08-31T00:24:10.275 INFO:teuthology.orchestra.run.smithi139.stdout:(20/131): python3-cephfs-18.0.0-5814.gcc14fc8a. 2.6 MB/s | 196 kB 00:00 2023-08-31T00:24:10.342 INFO:teuthology.orchestra.run.smithi139.stdout:(21/131): python3-rados-18.0.0-5814.gcc14fc8a.e 5.4 MB/s | 370 kB 00:00 2023-08-31T00:24:10.409 INFO:teuthology.orchestra.run.smithi139.stdout:(22/131): python3-rbd-18.0.0-5814.gcc14fc8a.el8 5.4 MB/s | 364 kB 00:00 2023-08-31T00:24:10.460 INFO:teuthology.orchestra.run.smithi077.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 4.0 MB/s | 1.5 MB 00:00 2023-08-31T00:24:10.467 INFO:teuthology.orchestra.run.smithi139.stdout:(23/131): python3-rgw-18.0.0-5814.gcc14fc8a.el8 1.8 MB/s | 107 kB 00:00 2023-08-31T00:24:10.542 INFO:teuthology.orchestra.run.smithi139.stdout:(24/131): rbd-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.2 MB/s | 94 kB 00:00 2023-08-31T00:24:10.569 INFO:teuthology.orchestra.run.smithi077.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 7.2 MB/s | 798 kB 00:00 2023-08-31T00:24:10.827 INFO:teuthology.orchestra.run.smithi077.stdout:(130/131): librbd1-18.0.0-5814.gcc14fc8a.el8.x8 6.4 MB/s | 3.6 MB 00:00 2023-08-31T00:24:10.926 INFO:teuthology.orchestra.run.smithi139.stdout:(25/131): ceph-radosgw-18.0.0-5814.gcc14fc8a.el 6.5 MB/s | 14 MB 00:02 2023-08-31T00:24:11.021 INFO:teuthology.orchestra.run.smithi139.stdout:(26/131): rbd-mirror-18.0.0-5814.gcc14fc8a.el8. 7.4 MB/s | 3.5 MB 00:00 2023-08-31T00:24:11.043 INFO:teuthology.orchestra.run.smithi139.stdout:(27/131): rbd-nbd-18.0.0-5814.gcc14fc8a.el8.x86 1.5 MB/s | 179 kB 00:00 2023-08-31T00:24:11.060 INFO:teuthology.orchestra.run.smithi139.stdout:(28/131): ceph-grafana-dashboards-18.0.0-5814.g 554 kB/s | 23 kB 00:00 2023-08-31T00:24:11.111 INFO:teuthology.orchestra.run.smithi139.stdout:(29/131): ceph-mgr-cephadm-18.0.0-5814.gcc14fc8 1.9 MB/s | 132 kB 00:00 2023-08-31T00:24:11.253 INFO:teuthology.orchestra.run.smithi139.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5814.gcc14f 9.1 MB/s | 1.7 MB 00:00 2023-08-31T00:24:11.311 INFO:teuthology.orchestra.run.smithi139.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5814.gcc 4.1 MB/s | 242 kB 00:00 2023-08-31T00:24:11.353 INFO:teuthology.orchestra.run.smithi139.stdout:(32/131): ceph-mgr-rook-18.0.0-5814.gcc14fc8a.e 1.1 MB/s | 47 kB 00:00 2023-08-31T00:24:11.387 INFO:teuthology.orchestra.run.smithi139.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5814.gc 436 kB/s | 15 kB 00:00 2023-08-31T00:24:11.403 INFO:teuthology.orchestra.run.smithi077.stdout:(131/131): librados2-18.0.0-5814.gcc14fc8a.el8. 2.9 MB/s | 3.7 MB 00:01 2023-08-31T00:24:11.407 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2023-08-31T00:24:11.408 INFO:teuthology.orchestra.run.smithi077.stdout:Total 16 MB/s | 206 MB 00:12 2023-08-31T00:24:11.437 INFO:teuthology.orchestra.run.smithi139.stdout:(34/131): ceph-volume-18.0.0-5814.gcc14fc8a.el8 5.1 MB/s | 261 kB 00:00 2023-08-31T00:24:11.495 INFO:teuthology.orchestra.run.smithi139.stdout:(35/131): cephadm-18.0.0-5814.gcc14fc8a.el8.noa 2.9 MB/s | 171 kB 00:00 2023-08-31T00:24:11.546 INFO:teuthology.orchestra.run.smithi139.stdout:(36/131): cephfs-top-18.0.0-5814.gcc14fc8a.el8. 360 kB/s | 18 kB 00:00 2023-08-31T00:24:11.780 INFO:teuthology.orchestra.run.smithi139.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-08-31T00:24:11.871 INFO:teuthology.orchestra.run.smithi139.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 943 kB/s | 306 kB 00:00 2023-08-31T00:24:11.950 INFO:teuthology.orchestra.run.smithi139.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 971 kB/s | 75 kB 00:00 2023-08-31T00:24:11.997 INFO:teuthology.orchestra.run.smithi139.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 271 kB/s | 59 kB 00:00 2023-08-31T00:24:12.039 INFO:teuthology.orchestra.run.smithi139.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.2 MB/s | 476 kB 00:00 2023-08-31T00:24:12.064 INFO:teuthology.orchestra.run.smithi139.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 654 kB/s | 44 kB 00:00 2023-08-31T00:24:12.089 INFO:teuthology.orchestra.run.smithi139.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-08-31T00:24:12.132 INFO:teuthology.orchestra.run.smithi139.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 491 kB/s | 33 kB 00:00 2023-08-31T00:24:12.157 INFO:teuthology.orchestra.run.smithi139.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-08-31T00:24:12.217 INFO:teuthology.orchestra.run.smithi139.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.5 MB/s | 384 kB 00:00 2023-08-31T00:24:12.229 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2023-08-31T00:24:12.232 INFO:teuthology.orchestra.run.smithi139.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-08-31T00:24:12.266 INFO:teuthology.orchestra.run.smithi139.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-08-31T00:24:12.325 INFO:teuthology.orchestra.run.smithi139.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-08-31T00:24:12.349 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2023-08-31T00:24:12.350 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2023-08-31T00:24:12.350 INFO:teuthology.orchestra.run.smithi139.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-08-31T00:24:12.409 INFO:teuthology.orchestra.run.smithi139.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 838 kB/s | 49 kB 00:00 2023-08-31T00:24:12.467 INFO:teuthology.orchestra.run.smithi139.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-08-31T00:24:12.509 INFO:teuthology.orchestra.run.smithi139.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 6.3 MB/s | 1.2 MB 00:00 2023-08-31T00:24:12.534 INFO:teuthology.orchestra.run.smithi139.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 904 kB/s | 60 kB 00:00 2023-08-31T00:24:12.568 INFO:teuthology.orchestra.run.smithi139.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-08-31T00:24:12.594 INFO:teuthology.orchestra.run.smithi139.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-08-31T00:24:12.627 INFO:teuthology.orchestra.run.smithi139.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 577 kB/s | 34 kB 00:00 2023-08-31T00:24:12.677 INFO:teuthology.orchestra.run.smithi139.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-08-31T00:24:12.711 INFO:teuthology.orchestra.run.smithi139.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 768 kB/s | 64 kB 00:00 2023-08-31T00:24:12.736 INFO:teuthology.orchestra.run.smithi139.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 318 kB/s | 19 kB 00:00 2023-08-31T00:24:12.770 INFO:teuthology.orchestra.run.smithi139.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-08-31T00:24:12.820 INFO:teuthology.orchestra.run.smithi139.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-08-31T00:24:12.846 INFO:teuthology.orchestra.run.smithi139.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-08-31T00:24:12.879 INFO:teuthology.orchestra.run.smithi139.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2023-08-31T00:24:12.904 INFO:teuthology.orchestra.run.smithi139.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-08-31T00:24:12.938 INFO:teuthology.orchestra.run.smithi139.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-08-31T00:24:12.963 INFO:teuthology.orchestra.run.smithi139.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-08-31T00:24:12.988 INFO:teuthology.orchestra.run.smithi139.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-08-31T00:24:13.051 INFO:teuthology.orchestra.run.smithi139.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.1 MB/s | 70 kB 00:00 2023-08-31T00:24:13.172 INFO:teuthology.orchestra.run.smithi139.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-08-31T00:24:13.189 INFO:teuthology.orchestra.run.smithi139.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 339 kB/s | 47 kB 00:00 2023-08-31T00:24:13.331 INFO:teuthology.orchestra.run.smithi139.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 301 kB/s | 43 kB 00:00 2023-08-31T00:24:13.365 INFO:teuthology.orchestra.run.smithi139.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.0 MB/s | 200 kB 00:00 2023-08-31T00:24:13.458 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2023-08-31T00:24:13.462 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2023-08-31T00:24:13.491 INFO:teuthology.orchestra.run.smithi139.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 385 kB/s | 48 kB 00:00 2023-08-31T00:24:13.516 INFO:teuthology.orchestra.run.smithi139.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-08-31T00:24:13.641 INFO:teuthology.orchestra.run.smithi139.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 579 kB/s | 87 kB 00:00 2023-08-31T00:24:13.658 INFO:teuthology.orchestra.run.smithi139.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 301 kB/s | 43 kB 00:00 2023-08-31T00:24:13.773 INFO:teuthology.orchestra.run.smithi139.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-08-31T00:24:13.808 INFO:teuthology.orchestra.run.smithi139.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 653 kB/s | 109 kB 00:00 2023-08-31T00:24:13.925 INFO:teuthology.orchestra.run.smithi139.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-08-31T00:24:13.984 INFO:teuthology.orchestra.run.smithi139.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 107 kB/s | 19 kB 00:00 2023-08-31T00:24:14.076 INFO:teuthology.orchestra.run.smithi139.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-08-31T00:24:14.143 INFO:teuthology.orchestra.run.smithi139.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 3.4 MB/s | 559 kB 00:00 2023-08-31T00:24:14.201 INFO:teuthology.orchestra.run.smithi139.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 143 kB/s | 18 kB 00:00 2023-08-31T00:24:14.285 INFO:teuthology.orchestra.run.smithi139.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-08-31T00:24:14.327 INFO:teuthology.orchestra.run.smithi139.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-08-31T00:24:14.496 INFO:teuthology.orchestra.run.smithi139.stdout:(87/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 11 MB/s | 2.3 MB 00:00 2023-08-31T00:24:14.519 INFO:teuthology.orchestra.run.smithi139.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 377 kB/s | 72 kB 00:00 2023-08-31T00:24:14.636 INFO:teuthology.orchestra.run.smithi139.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 594 kB/s | 83 kB 00:00 2023-08-31T00:24:14.678 INFO:teuthology.orchestra.run.smithi139.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 378 kB/s | 60 kB 00:00 2023-08-31T00:24:14.753 INFO:teuthology.orchestra.run.smithi139.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 841 kB/s | 98 kB 00:00 2023-08-31T00:24:14.820 INFO:teuthology.orchestra.run.smithi139.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 406 kB/s | 58 kB 00:00 2023-08-31T00:24:14.887 INFO:teuthology.orchestra.run.smithi139.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 289 kB/s | 39 kB 00:00 2023-08-31T00:24:15.013 INFO:teuthology.orchestra.run.smithi139.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.3 MB/s | 644 kB 00:00 2023-08-31T00:24:15.046 INFO:teuthology.orchestra.run.smithi139.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.1 MB/s | 171 kB 00:00 2023-08-31T00:24:15.155 INFO:teuthology.orchestra.run.smithi139.stdout:(96/131): NetworkManager-initscripts-updown-1.3 971 kB/s | 138 kB 00:00 2023-08-31T00:24:15.346 INFO:teuthology.orchestra.run.smithi139.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 575 kB/s | 110 kB 00:00 2023-08-31T00:24:15.514 INFO:teuthology.orchestra.run.smithi139.stdout:(98/131): python3-scipy-1.0.0-21.module+el8.5.0 29 MB/s | 14 MB 00:00 2023-08-31T00:24:15.539 INFO:teuthology.orchestra.run.smithi139.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 282 kB/s | 54 kB 00:00 2023-08-31T00:24:15.647 INFO:teuthology.orchestra.run.smithi139.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-08-31T00:24:15.698 INFO:teuthology.orchestra.run.smithi139.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2023-08-31T00:24:15.765 INFO:teuthology.orchestra.run.smithi139.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 331 kB/s | 39 kB 00:00 2023-08-31T00:24:15.799 INFO:teuthology.orchestra.run.smithi139.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-08-31T00:24:15.865 INFO:teuthology.orchestra.run.smithi139.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-08-31T00:24:15.966 INFO:teuthology.orchestra.run.smithi139.stdout:(105/131): python3-jinja2-2.10.1-3.el8.noarch.r 2.6 MB/s | 538 kB 00:00 2023-08-31T00:24:16.008 INFO:teuthology.orchestra.run.smithi139.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-08-31T00:24:16.100 INFO:teuthology.orchestra.run.smithi139.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2023-08-31T00:24:16.225 INFO:teuthology.orchestra.run.smithi139.stdout:(108/131): python3-babel-2.5.1-7.el8.noarch.rpm 22 MB/s | 4.8 MB 00:00 2023-08-31T00:24:16.242 INFO:teuthology.orchestra.run.smithi139.stdout:(109/131): python3-jsonpatch-1.21-2.el8.noarch. 187 kB/s | 27 kB 00:00 2023-08-31T00:24:16.375 INFO:teuthology.orchestra.run.smithi139.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2023-08-31T00:24:16.392 INFO:teuthology.orchestra.run.smithi139.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 292 kB/s | 44 kB 00:00 2023-08-31T00:24:16.528 INFO:teuthology.orchestra.run.smithi139.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 3.4 MB/s | 457 kB 00:00 2023-08-31T00:24:16.601 INFO:teuthology.orchestra.run.smithi139.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-08-31T00:24:16.718 INFO:teuthology.orchestra.run.smithi139.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.1 MB/s | 225 kB 00:00 2023-08-31T00:24:16.744 INFO:teuthology.orchestra.run.smithi139.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 451 kB/s | 64 kB 00:00 2023-08-31T00:24:16.794 INFO:teuthology.orchestra.run.smithi139.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2023-08-31T00:24:16.869 INFO:teuthology.orchestra.run.smithi139.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 160 kB/s | 20 kB 00:00 2023-08-31T00:24:16.903 INFO:teuthology.orchestra.run.smithi139.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 953 kB/s | 103 kB 00:00 2023-08-31T00:24:17.345 INFO:teuthology.orchestra.run.smithi139.stdout:(119/131): ceph-test-18.0.0-5814.gcc14fc8a.el8. 5.9 MB/s | 48 MB 00:08 2023-08-31T00:24:17.403 INFO:teuthology.orchestra.run.smithi139.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 1.3 MB/s | 709 kB 00:00 2023-08-31T00:24:17.512 INFO:teuthology.orchestra.run.smithi139.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 8.0 MB/s | 4.9 MB 00:00 2023-08-31T00:24:17.554 INFO:teuthology.orchestra.run.smithi139.stdout:(122/131): libpq-13.5-1.el8.x86_64.rpm 949 kB/s | 198 kB 00:00 2023-08-31T00:24:17.596 INFO:teuthology.orchestra.run.smithi139.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2023-08-31T00:24:17.704 INFO:teuthology.orchestra.run.smithi139.stdout:(124/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-08-31T00:24:17.763 INFO:teuthology.orchestra.run.smithi139.stdout:(125/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-08-31T00:24:17.872 INFO:teuthology.orchestra.run.smithi139.stdout:(126/131): postgresql-server-10.21-2.module+el8 18 MB/s | 5.1 MB 00:00 2023-08-31T00:24:17.980 INFO:teuthology.orchestra.run.smithi139.stdout:(127/131): postgresql-contrib-10.21-2.module+el 2.9 MB/s | 808 kB 00:00 2023-08-31T00:24:18.139 INFO:teuthology.orchestra.run.smithi139.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 4.0 MB/s | 1.5 MB 00:00 2023-08-31T00:24:18.222 INFO:teuthology.orchestra.run.smithi139.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 9.4 MB/s | 798 kB 00:00 2023-08-31T00:24:18.456 INFO:teuthology.orchestra.run.smithi139.stdout:(130/131): librados2-18.0.0-5814.gcc14fc8a.el8. 6.3 MB/s | 3.7 MB 00:00 2023-08-31T00:24:18.631 INFO:teuthology.orchestra.run.smithi139.stdout:(131/131): librbd1-18.0.0-5814.gcc14fc8a.el8.x8 5.6 MB/s | 3.6 MB 00:00 2023-08-31T00:24:18.635 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-08-31T00:24:18.635 INFO:teuthology.orchestra.run.smithi139.stdout:Total 17 MB/s | 206 MB 00:12 2023-08-31T00:24:18.712 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2023-08-31T00:24:18.934 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-31T00:24:19.134 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-31T00:24:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T00:24:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T00:24:19.473 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-08-31T00:24:19.593 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-08-31T00:24:19.594 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-08-31T00:24:19.653 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T00:24:20.057 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T00:24:20.310 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T00:24:20.712 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T00:24:20.730 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-08-31T00:24:20.734 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-08-31T00:24:20.927 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T00:24:21.036 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T00:24:21.235 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T00:24:21.332 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T00:24:21.861 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T00:24:22.088 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-31T00:24:22.353 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-31T00:24:22.548 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-31T00:24:22.977 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-31T00:24:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-31T00:24:23.469 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T00:24:23.573 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T00:24:23.760 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T00:24:23.907 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T00:24:24.088 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-31T00:24:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-31T00:24:24.444 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-31T00:24:24.593 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T00:24:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T00:24:24.910 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T00:24:25.512 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T00:24:25.727 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T00:24:25.976 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-08-31T00:24:26.156 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-31T00:24:26.304 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T00:24:26.369 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-31T00:24:26.535 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T00:24:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T00:24:26.691 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T00:24:26.914 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T00:24:27.248 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T00:24:27.318 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T00:24:27.521 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T00:24:27.697 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-31T00:24:27.887 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-31T00:24:27.899 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T00:24:28.122 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-31T00:24:28.146 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T00:24:28.272 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T00:24:28.333 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 26/134 2023-08-31T00:24:28.484 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 27/134 2023-08-31T00:24:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T00:24:28.603 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T00:24:28.737 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 28/134 2023-08-31T00:24:28.792 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T00:24:28.926 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T00:24:28.980 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-31T00:24:29.335 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-31T00:24:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-31T00:24:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-31T00:24:30.275 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-31T00:24:30.454 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T00:24:30.559 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T00:24:30.690 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T00:24:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T00:24:30.885 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T00:24:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-31T00:24:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-31T00:24:31.466 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-31T00:24:31.620 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T00:24:31.712 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-31T00:24:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T00:24:31.937 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T00:24:32.030 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-31T00:24:32.311 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-31T00:24:32.550 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T00:24:32.568 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-31T00:24:32.721 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T00:24:32.796 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-31T00:24:33.002 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-31T00:24:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 36/134 2023-08-31T00:24:33.348 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T00:24:33.357 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 37/134 2023-08-31T00:24:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-31T00:24:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T00:24:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-31T00:24:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T00:24:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T00:24:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-31T00:24:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T00:24:34.437 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-31T00:24:34.643 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T00:24:34.722 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T00:24:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-31T00:24:34.939 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-31T00:24:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-31T00:24:35.080 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-31T00:24:35.245 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-31T00:24:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-31T00:24:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 26/134 2023-08-31T00:24:35.445 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-31T00:24:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 27/134 2023-08-31T00:24:35.620 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-31T00:24:35.788 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-31T00:24:35.881 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 28/134 2023-08-31T00:24:36.008 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-31T00:24:36.096 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T00:24:36.248 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-31T00:24:36.602 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-31T00:24:36.893 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-31T00:24:37.103 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-31T00:24:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-31T00:24:37.579 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-31T00:24:37.866 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T00:24:37.924 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-31T00:24:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-31T00:24:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-31T00:24:38.620 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-31T00:24:38.832 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-31T00:24:38.884 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-31T00:24:39.003 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-31T00:24:39.250 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-31T00:24:39.318 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-31T00:24:39.529 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-31T00:24:39.603 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-31T00:24:39.776 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-31T00:24:39.837 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-31T00:24:40.084 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-31T00:24:40.125 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-31T00:24:40.283 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-31T00:24:40.421 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-31T00:24:40.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-31T00:24:40.617 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 36/134 2023-08-31T00:24:40.743 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-31T00:24:40.796 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 37/134 2023-08-31T00:24:40.944 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-31T00:24:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-31T00:24:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-31T00:24:41.146 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-31T00:24:41.285 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T00:24:41.293 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-31T00:24:41.343 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T00:24:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-31T00:24:41.571 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-31T00:24:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-31T00:24:41.797 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-31T00:24:41.918 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-31T00:24:41.977 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T00:24:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T00:24:42.069 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-31T00:24:42.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-31T00:24:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-31T00:24:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-31T00:24:42.455 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-31T00:24:42.636 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-31T00:24:42.670 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-31T00:24:42.821 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-31T00:24:42.880 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-31T00:24:43.013 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-31T00:24:43.148 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-31T00:24:43.155 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-31T00:24:43.343 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-31T00:24:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-31T00:24:43.543 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-31T00:24:43.583 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-31T00:24:43.810 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-31T00:24:43.944 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-31T00:24:44.238 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-31T00:24:44.496 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-31T00:24:44.741 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-31T00:24:44.891 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-31T00:24:44.981 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-31T00:24:45.161 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-31T00:24:45.318 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-31T00:24:45.398 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-31T00:24:45.601 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-31T00:24:45.715 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-31T00:24:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-31T00:24:46.012 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-31T00:24:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-31T00:24:46.188 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-31T00:24:46.226 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-31T00:24:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-31T00:24:46.771 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-31T00:24:47.013 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-31T00:24:47.023 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-31T00:24:47.215 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T00:24:47.255 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-31T00:24:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T00:24:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 93/134 2023-08-31T00:24:47.511 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-31T00:24:47.675 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-31T00:24:47.879 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-31T00:24:48.190 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-31T00:24:48.399 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-31T00:24:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-31T00:24:48.728 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-31T00:24:48.943 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-31T00:24:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-31T00:24:49.370 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-31T00:24:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-31T00:24:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-31T00:24:49.940 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-31T00:24:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-31T00:24:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-31T00:24:50.683 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-31T00:24:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-31T00:24:51.135 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-31T00:24:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T00:24:51.340 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-31T00:24:51.391 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T00:24:51.997 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T00:24:52.307 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T00:24:52.391 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T00:24:52.432 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-31T00:24:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T00:24:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-31T00:24:52.983 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-31T00:24:53.276 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-31T00:24:53.566 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-31T00:24:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-31T00:24:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-31T00:24:54.817 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T00:24:54.890 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T00:24:55.092 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 93/134 2023-08-31T00:24:58.799 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T00:24:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T00:24:59.649 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T00:24:59.947 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T00:25:00.033 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T00:25:00.224 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T00:25:11.297 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T00:25:11.297 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2023-08-31T00:25:11.297 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2023-08-31T00:25:11.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /dev 2023-08-31T00:25:11.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /run 2023-08-31T00:25:11.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2023-08-31T00:25:11.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2023-08-31T00:25:11.298 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2023-08-31T00:25:11.299 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2023-08-31T00:25:11.299 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /dev 2023-08-31T00:25:11.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:11.638 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T00:25:13.227 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T00:25:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T00:25:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T00:25:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T00:25:14.283 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T00:25:14.512 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T00:25:14.529 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T00:25:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T00:25:16.424 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T00:25:16.551 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 102/134 2023-08-31T00:25:16.769 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 103/134 2023-08-31T00:25:16.929 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T00:25:17.148 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T00:25:17.454 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T00:25:18.411 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T00:25:18.603 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T00:25:18.693 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T00:25:19.101 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 107/134 2023-08-31T00:25:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T00:25:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T00:25:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T00:25:19.370 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2023-08-31T00:25:19.371 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2023-08-31T00:25:19.371 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /dev 2023-08-31T00:25:19.371 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /run 2023-08-31T00:25:19.371 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2023-08-31T00:25:19.371 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2023-08-31T00:25:19.372 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2023-08-31T00:25:19.372 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2023-08-31T00:25:19.372 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /dev 2023-08-31T00:25:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:19.503 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T00:25:19.514 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T00:25:19.687 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T00:25:20.818 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 110/134 2023-08-31T00:25:21.032 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T00:25:21.067 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T00:25:21.262 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T00:25:21.268 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T00:25:21.303 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T00:25:21.443 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T00:25:21.453 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T00:25:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T00:25:21.804 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T00:25:21.804 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T00:25:22.003 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T00:25:22.268 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T00:25:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T00:25:22.521 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T00:25:24.165 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T00:25:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T00:25:24.475 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 102/134 2023-08-31T00:25:24.694 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 103/134 2023-08-31T00:25:24.878 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T00:25:25.097 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T00:25:25.409 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T00:25:26.369 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T00:25:26.544 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T00:25:26.565 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T00:25:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T00:25:27.049 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 107/134 2023-08-31T00:25:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T00:25:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T00:25:27.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 115/134 2023-08-31T00:25:27.452 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T00:25:27.463 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T00:25:27.776 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-31T00:25:28.000 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 117/134 2023-08-31T00:25:28.242 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-31T00:25:28.418 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T00:25:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T00:25:28.817 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 110/134 2023-08-31T00:25:28.848 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-31T00:25:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 121/134 2023-08-31T00:25:29.069 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T00:25:29.103 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T00:25:29.186 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T00:25:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T00:25:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T00:25:29.461 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T00:25:29.814 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T00:25:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T00:25:31.510 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T00:25:31.836 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T00:25:31.853 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T00:25:32.119 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 124/134 2023-08-31T00:25:32.276 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 125/134 2023-08-31T00:25:32.578 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 126/134 2023-08-31T00:25:32.963 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-31T00:25:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T00:25:33.243 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T00:25:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T00:25:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T00:25:33.618 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T00:25:33.626 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T00:25:33.762 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-31T00:25:33.762 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T00:25:33.988 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T00:25:33.988 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T00:25:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T00:25:34.417 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T00:25:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T00:25:34.901 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T00:25:34.901 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 1/134 2023-08-31T00:25:34.901 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2/134 2023-08-31T00:25:34.902 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 3/134 2023-08-31T00:25:34.902 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 4/134 2023-08-31T00:25:34.902 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 5/134 2023-08-31T00:25:34.902 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T00:25:34.903 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T00:25:34.903 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T00:25:34.903 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T00:25:34.903 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 10/134 2023-08-31T00:25:34.904 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 11/134 2023-08-31T00:25:34.904 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 12/134 2023-08-31T00:25:34.905 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 13/134 2023-08-31T00:25:34.905 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 14/134 2023-08-31T00:25:34.905 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 15/134 2023-08-31T00:25:34.906 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 16/134 2023-08-31T00:25:34.906 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 17/134 2023-08-31T00:25:34.906 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 18/134 2023-08-31T00:25:34.907 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 19/134 2023-08-31T00:25:34.907 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 20/134 2023-08-31T00:25:34.907 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 21/134 2023-08-31T00:25:34.908 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 22/134 2023-08-31T00:25:34.908 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 23/134 2023-08-31T00:25:34.908 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 24/134 2023-08-31T00:25:34.909 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 25/134 2023-08-31T00:25:34.909 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 26/134 2023-08-31T00:25:34.909 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 27/134 2023-08-31T00:25:34.920 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 28/134 2023-08-31T00:25:34.920 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 29/134 2023-08-31T00:25:34.921 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 30/134 2023-08-31T00:25:34.921 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 31/134 2023-08-31T00:25:34.921 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 32/134 2023-08-31T00:25:34.922 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 33/134 2023-08-31T00:25:34.922 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 34/134 2023-08-31T00:25:34.922 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 35/134 2023-08-31T00:25:34.922 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 36/134 2023-08-31T00:25:34.923 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 37/134 2023-08-31T00:25:34.923 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 38/134 2023-08-31T00:25:34.923 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-31T00:25:34.923 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-31T00:25:34.924 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-31T00:25:34.924 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-31T00:25:34.924 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-31T00:25:34.925 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-31T00:25:34.925 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-31T00:25:34.925 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-31T00:25:34.925 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-31T00:25:34.926 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-31T00:25:34.926 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-31T00:25:34.926 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-31T00:25:34.926 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-31T00:25:34.927 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-31T00:25:34.927 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-31T00:25:34.927 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-31T00:25:34.927 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-31T00:25:34.927 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-31T00:25:34.928 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-31T00:25:34.928 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-31T00:25:34.928 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-31T00:25:34.928 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-31T00:25:34.928 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-31T00:25:34.928 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-31T00:25:34.929 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-31T00:25:34.929 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-31T00:25:34.929 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-31T00:25:34.929 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-31T00:25:34.929 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-31T00:25:34.930 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-31T00:25:34.930 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-31T00:25:34.930 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-31T00:25:34.930 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-31T00:25:34.930 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-31T00:25:34.931 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-31T00:25:34.931 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-31T00:25:34.931 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-31T00:25:34.931 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-31T00:25:34.931 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-31T00:25:34.931 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-31T00:25:34.932 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-31T00:25:34.932 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-31T00:25:34.932 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-31T00:25:34.932 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-31T00:25:34.932 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-31T00:25:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-31T00:25:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-31T00:25:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-31T00:25:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-31T00:25:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-31T00:25:34.933 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-31T00:25:34.934 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-31T00:25:34.934 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-31T00:25:34.934 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-31T00:25:34.934 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-31T00:25:34.934 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-31T00:25:34.935 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-31T00:25:34.935 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-31T00:25:34.935 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-31T00:25:34.935 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-31T00:25:34.935 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-31T00:25:34.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-31T00:25:34.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-31T00:25:34.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-31T00:25:34.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-31T00:25:34.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-31T00:25:34.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-31T00:25:34.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-31T00:25:34.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-31T00:25:34.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-31T00:25:34.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-31T00:25:34.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-31T00:25:34.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-31T00:25:34.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-31T00:25:34.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-31T00:25:34.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-31T00:25:34.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-31T00:25:34.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-31T00:25:34.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-31T00:25:34.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-31T00:25:34.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-31T00:25:34.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-31T00:25:34.940 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-31T00:25:34.940 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-31T00:25:34.940 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-31T00:25:34.940 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-31T00:25:34.940 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-31T00:25:34.940 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-31T00:25:34.941 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-31T00:25:34.941 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-31T00:25:34.941 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 129/134 2023-08-31T00:25:34.941 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-31T00:25:34.941 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 131/134 2023-08-31T00:25:34.942 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T00:25:34.942 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-31T00:25:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 115/134 2023-08-31T00:25:35.783 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-31T00:25:36.001 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 117/134 2023-08-31T00:25:36.235 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-31T00:25:36.392 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T00:25:36.592 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T00:25:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-31T00:25:37.030 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 121/134 2023-08-31T00:25:37.177 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T00:25:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T00:25:37.633 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:51 ago on Thu 31 Aug 2023 12:23:46 AM UTC. 2023-08-31T00:25:39.444 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T00:25:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T00:25:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T00:25:39.937 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 124/134 2023-08-31T00:25:40.191 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 125/134 2023-08-31T00:25:40.501 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 126/134 2023-08-31T00:25:40.903 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-31T00:25:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T00:25:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T00:25:41.409 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T00:25:41.421 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T00:25:41.558 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T00:25:41.566 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T00:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-31T00:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T00:25:41.920 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T00:25:41.921 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T00:25:42.188 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T00:25:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T00:25:42.854 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T00:25:42.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 1/134 2023-08-31T00:25:42.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2/134 2023-08-31T00:25:42.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 3/134 2023-08-31T00:25:42.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 4/134 2023-08-31T00:25:42.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 5/134 2023-08-31T00:25:42.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T00:25:42.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T00:25:42.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T00:25:42.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T00:25:42.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 10/134 2023-08-31T00:25:42.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 11/134 2023-08-31T00:25:42.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 12/134 2023-08-31T00:25:42.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 13/134 2023-08-31T00:25:42.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 14/134 2023-08-31T00:25:42.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 15/134 2023-08-31T00:25:42.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 16/134 2023-08-31T00:25:42.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 17/134 2023-08-31T00:25:42.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 18/134 2023-08-31T00:25:42.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 19/134 2023-08-31T00:25:42.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 20/134 2023-08-31T00:25:42.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 21/134 2023-08-31T00:25:42.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 22/134 2023-08-31T00:25:42.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 23/134 2023-08-31T00:25:42.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 24/134 2023-08-31T00:25:42.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 25/134 2023-08-31T00:25:42.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 26/134 2023-08-31T00:25:42.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 27/134 2023-08-31T00:25:42.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 28/134 2023-08-31T00:25:42.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 29/134 2023-08-31T00:25:42.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 30/134 2023-08-31T00:25:42.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 31/134 2023-08-31T00:25:42.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 32/134 2023-08-31T00:25:42.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 33/134 2023-08-31T00:25:42.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 34/134 2023-08-31T00:25:42.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 35/134 2023-08-31T00:25:42.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 36/134 2023-08-31T00:25:42.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 37/134 2023-08-31T00:25:42.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 38/134 2023-08-31T00:25:42.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-31T00:25:42.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-31T00:25:42.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-31T00:25:42.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-31T00:25:42.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-31T00:25:42.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-31T00:25:42.865 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-31T00:25:42.865 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-31T00:25:42.865 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-31T00:25:42.865 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-31T00:25:42.865 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-31T00:25:42.866 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-31T00:25:42.866 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-31T00:25:42.866 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-31T00:25:42.866 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-31T00:25:42.866 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-31T00:25:42.867 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-31T00:25:42.867 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-31T00:25:42.867 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-31T00:25:42.867 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-31T00:25:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-31T00:25:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-31T00:25:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-31T00:25:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-31T00:25:42.868 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-31T00:25:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-31T00:25:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-31T00:25:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-31T00:25:42.869 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-31T00:25:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-31T00:25:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-31T00:25:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-31T00:25:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-31T00:25:42.870 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-31T00:25:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-31T00:25:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-31T00:25:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-31T00:25:42.871 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-31T00:25:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-31T00:25:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-31T00:25:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-31T00:25:42.872 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-31T00:25:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-31T00:25:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-31T00:25:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-31T00:25:42.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-31T00:25:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-31T00:25:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-31T00:25:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-31T00:25:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-31T00:25:42.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-31T00:25:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-31T00:25:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-31T00:25:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-31T00:25:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-31T00:25:42.875 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-31T00:25:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-31T00:25:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-31T00:25:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-31T00:25:42.876 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-31T00:25:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-31T00:25:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-31T00:25:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-31T00:25:42.877 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-31T00:25:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-31T00:25:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-31T00:25:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-31T00:25:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-31T00:25:42.878 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-31T00:25:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-31T00:25:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-31T00:25:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-31T00:25:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-31T00:25:42.879 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-31T00:25:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-31T00:25:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-31T00:25:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-31T00:25:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-31T00:25:42.880 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-31T00:25:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-31T00:25:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-31T00:25:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-31T00:25:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-31T00:25:42.881 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-31T00:25:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-31T00:25:42.882 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-31T00:25:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-31T00:25:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-31T00:25:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-31T00:25:42.883 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-31T00:25:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 129/134 2023-08-31T00:25:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-31T00:25:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 131/134 2023-08-31T00:25:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T00:25:42.884 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-31T00:25:45.663 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T00:25:45.663 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:51 ago on Thu 31 Aug 2023 12:23:54 AM UTC. 2023-08-31T00:25:47.256 INFO:teuthology.orchestra.run.smithi077.stdout:Installed products updated. 2023-08-31T00:25:47.467 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:47.467 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2023-08-31T00:25:47.467 INFO:teuthology.orchestra.run.smithi077.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-31T00:25:47.468 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.468 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.468 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2023-08-31T00:25:47.468 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-31T00:25:47.468 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.1-7.el8.noarch 2023-08-31T00:25:47.469 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T00:25:47.469 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.469 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.469 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.469 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.469 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.470 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.470 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.470 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.470 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.470 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.470 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.471 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.471 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.471 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.471 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.471 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.471 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.472 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.472 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.472 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.472 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.472 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.473 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:47.473 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-31T00:25:47.473 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T00:25:47.473 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-31T00:25:47.473 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T00:25:47.474 INFO:teuthology.orchestra.run.smithi077.stdout: jq-1.6-3.el8.x86_64 2023-08-31T00:25:47.474 INFO:teuthology.orchestra.run.smithi077.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T00:25:47.474 INFO:teuthology.orchestra.run.smithi077.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-31T00:25:47.474 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T00:25:47.474 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.475 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.475 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.475 INFO:teuthology.orchestra.run.smithi077.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-31T00:25:47.475 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-31T00:25:47.475 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T00:25:47.476 INFO:teuthology.orchestra.run.smithi077.stdout: libpq-13.5-1.el8.x86_64 2023-08-31T00:25:47.476 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-31T00:25:47.476 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-31T00:25:47.476 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.476 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.477 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T00:25:47.477 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.477 INFO:teuthology.orchestra.run.smithi077.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-31T00:25:47.477 INFO:teuthology.orchestra.run.smithi077.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T00:25:47.477 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T00:25:47.478 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T00:25:47.478 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-31T00:25:47.478 INFO:teuthology.orchestra.run.smithi077.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-31T00:25:47.478 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T00:25:47.478 INFO:teuthology.orchestra.run.smithi077.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T00:25:47.479 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-31T00:25:47.479 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-31T00:25:47.479 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-31T00:25:47.479 INFO:teuthology.orchestra.run.smithi077.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-31T00:25:47.479 INFO:teuthology.orchestra.run.smithi077.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-31T00:25:47.479 INFO:teuthology.orchestra.run.smithi077.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-31T00:25:47.480 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T00:25:47.480 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T00:25:47.480 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T00:25:47.480 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-31T00:25:47.480 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T00:25:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T00:25:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T00:25:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T00:25:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.481 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.482 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.482 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T00:25:47.482 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-31T00:25:47.482 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T00:25:47.483 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T00:25:47.483 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-31T00:25:47.483 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T00:25:47.483 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T00:25:47.483 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T00:25:47.483 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T00:25:47.484 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T00:25:47.484 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T00:25:47.484 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T00:25:47.484 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T00:25:47.484 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T00:25:47.485 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-31T00:25:47.485 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T00:25:47.485 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T00:25:47.485 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-31T00:25:47.485 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T00:25:47.485 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T00:25:47.486 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T00:25:47.486 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T00:25:47.486 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T00:25:47.486 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T00:25:47.486 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T00:25:47.487 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T00:25:47.487 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T00:25:47.487 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T00:25:47.487 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-31T00:25:47.487 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.488 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.488 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T00:25:47.488 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T00:25:47.488 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.488 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T00:25:47.489 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T00:25:47.489 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-31T00:25:47.489 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T00:25:47.489 INFO:teuthology.orchestra.run.smithi077.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T00:25:47.489 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T00:25:47.489 INFO:teuthology.orchestra.run.smithi077.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T00:25:47.490 INFO:teuthology.orchestra.run.smithi077.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T00:25:47.490 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T00:25:47.490 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T00:25:47.490 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T00:25:47.490 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T00:25:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T00:25:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T00:25:47.491 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-31T00:25:47.492 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-31T00:25:47.492 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-31T00:25:47.492 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T00:25:47.493 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-31T00:25:47.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-08-31T00:25:47.631 DEBUG:teuthology.parallel:result is None 2023-08-31T00:25:54.570 INFO:teuthology.orchestra.run.smithi139.stdout:Installed products updated. 2023-08-31T00:25:54.786 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:54.786 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2023-08-31T00:25:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-31T00:25:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.787 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-08-31T00:25:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-31T00:25:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.1-7.el8.noarch 2023-08-31T00:25:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T00:25:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.789 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.790 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.790 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.790 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.790 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.791 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.791 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.791 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.791 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.791 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.792 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.792 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.792 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.792 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.792 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.793 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T00:25:54.793 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-31T00:25:54.793 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T00:25:54.793 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-31T00:25:54.793 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T00:25:54.794 INFO:teuthology.orchestra.run.smithi139.stdout: jq-1.6-3.el8.x86_64 2023-08-31T00:25:54.794 INFO:teuthology.orchestra.run.smithi139.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T00:25:54.794 INFO:teuthology.orchestra.run.smithi139.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-31T00:25:54.794 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T00:25:54.794 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.795 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.795 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.795 INFO:teuthology.orchestra.run.smithi139.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-31T00:25:54.795 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-31T00:25:54.795 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T00:25:54.796 INFO:teuthology.orchestra.run.smithi139.stdout: libpq-13.5-1.el8.x86_64 2023-08-31T00:25:54.796 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-31T00:25:54.796 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-31T00:25:54.796 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.796 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.797 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T00:25:54.797 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.797 INFO:teuthology.orchestra.run.smithi139.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-31T00:25:54.797 INFO:teuthology.orchestra.run.smithi139.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T00:25:54.797 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T00:25:54.798 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T00:25:54.798 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-31T00:25:54.798 INFO:teuthology.orchestra.run.smithi139.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-31T00:25:54.798 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T00:25:54.798 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T00:25:54.799 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-31T00:25:54.799 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-31T00:25:54.799 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-31T00:25:54.799 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-31T00:25:54.799 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-31T00:25:54.800 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-31T00:25:54.800 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T00:25:54.800 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T00:25:54.800 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T00:25:54.800 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-31T00:25:54.801 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T00:25:54.801 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T00:25:54.801 INFO:teuthology.orchestra.run.smithi139.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T00:25:54.801 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T00:25:54.801 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T00:25:54.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-31T00:25:54.802 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T00:25:54.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T00:25:54.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-31T00:25:54.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T00:25:54.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T00:25:54.803 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T00:25:54.804 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T00:25:54.804 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T00:25:54.804 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T00:25:54.804 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T00:25:54.804 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T00:25:54.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T00:25:54.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-31T00:25:54.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T00:25:54.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T00:25:54.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-31T00:25:54.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T00:25:54.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T00:25:54.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T00:25:54.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T00:25:54.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T00:25:54.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T00:25:54.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T00:25:54.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T00:25:54.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T00:25:54.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T00:25:54.807 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-31T00:25:54.808 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.808 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.808 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T00:25:54.808 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T00:25:54.808 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.809 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T00:25:54.809 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T00:25:54.809 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-31T00:25:54.809 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T00:25:54.809 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T00:25:54.810 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T00:25:54.810 INFO:teuthology.orchestra.run.smithi139.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T00:25:54.810 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T00:25:54.810 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T00:25:54.810 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T00:25:54.811 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T00:25:54.811 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T00:25:54.811 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T00:25:54.811 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.811 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.812 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T00:25:54.812 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T00:25:54.812 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-31T00:25:54.812 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-31T00:25:54.812 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-31T00:25:54.813 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T00:25:54.813 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-31T00:25:54.813 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:54.814 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-08-31T00:25:55.063 DEBUG:teuthology.parallel:result is None 2023-08-31T00:25:55.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T00:25:55.283 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T00:25:55.312 INFO:teuthology.orchestra.run.smithi077.stdout:18.0.0-5814.gcc14fc8a.el8 2023-08-31T00:25:55.313 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5814.gcc14fc8a.el8 2023-08-31T00:25:55.313 INFO:teuthology.task.install:The correct ceph version 18.0.0-5814.gcc14fc8a is installed. 2023-08-31T00:25:55.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T00:25:55.532 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T00:25:55.557 INFO:teuthology.orchestra.run.smithi139.stdout:18.0.0-5814.gcc14fc8a.el8 2023-08-31T00:25:55.558 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5814.gcc14fc8a.el8 2023-08-31T00:25:55.558 INFO:teuthology.task.install:The correct ceph version 18.0.0-5814.gcc14fc8a is installed. 2023-08-31T00:25:55.559 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-31T00:25:55.559 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:55.560 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T00:25:55.608 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:55.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T00:25:55.649 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-31T00:25:55.650 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:55.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T00:25:55.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T00:25:55.747 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:55.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T00:25:55.774 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T00:25:55.841 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-31T00:25:55.841 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:55.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T00:25:55.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T00:25:55.936 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:55.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T00:25:55.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T00:25:56.030 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-31T00:25:56.030 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:56.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T00:25:56.058 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T00:25:56.125 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:56.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T00:25:56.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T00:25:56.218 INFO:teuthology.run_tasks:Running task ceph... 2023-08-31T00:25:56.286 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-31T00:25:56.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2023-08-31T00:25:56.289 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2023-08-31T00:25:56.318 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-31T00:25:56.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T00:25:56.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T00:25:56.384 INFO:tasks.ceph:Creating extra log directories... 2023-08-31T00:25:56.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T00:25:56.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T00:25:56.458 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-31T00:25:56.458 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-31T00:25:56.459 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-31T00:25:56.459 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:56.459 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T00:25:56.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T00:25:56.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T00:25:56.672 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:56.672 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T00:25:56.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T00:25:56.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T00:25:56.860 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-31T00:25:56.860 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-31T00:25:56.861 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384998', 'branch': 'wip-batrick-testing-20230830.165602', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7384998', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-08-30_23:48:03-fs-wip-batrick-testing-20230830.165602-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230830.165602'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230830.165602', 'sha1': '833faa571491534dcb6bc6b25a578499081113d8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6543, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'sleep_before_teardown': 0, 'subset': '131/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230830.165602', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_833faa571491534dcb6bc6b25a578499081113d8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '833faa571491534dcb6bc6b25a578499081113d8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f9a8556d5e989d27b6626a0b75ef595991f83d20', 'timestamp': '2023-08-30_23:48:03', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-08-31T00:25:56.862 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T00:25:56.864 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T00:25:56.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T00:25:56.921 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T00:25:56.977 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:56.977 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T00:25:57.002 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T00:25:57.003 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2023-08-31T00:25:57.059 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T00:25:57.059 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:57.060 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 388293 Links: 1 2023-08-31T00:25:57.060 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:57.060 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:57.060 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-08-31 00:25:34.609615134 +0000 2023-08-31T00:25:57.060 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-08-31 00:22:50.193904384 +0000 2023-08-31T00:25:57.061 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-08-31 00:22:50.193904384 +0000 2023-08-31T00:25:57.061 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-08-31T00:25:57.061 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T00:25:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-08-31T00:25:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-08-31T00:25:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00022809 s, 2.2 MB/s 2023-08-31T00:25:57.125 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T00:25:57.182 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2023-08-31T00:25:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T00:25:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 387653 Links: 1 2023-08-31T00:25:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:57.240 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-08-31 00:25:34.609615134 +0000 2023-08-31T00:25:57.240 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-08-31 00:22:50.704893429 +0000 2023-08-31T00:25:57.240 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-08-31 00:22:50.704893429 +0000 2023-08-31T00:25:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-08-31T00:25:57.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T00:25:57.302 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-08-31T00:25:57.303 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-08-31T00:25:57.303 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000233426 s, 2.2 MB/s 2023-08-31T00:25:57.304 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T00:25:57.362 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2023-08-31T00:25:57.419 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T00:25:57.419 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:57.419 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 388704 Links: 1 2023-08-31T00:25:57.419 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:57.420 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:57.420 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-08-31 00:25:34.609615134 +0000 2023-08-31T00:25:57.420 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-08-31 00:22:51.206882666 +0000 2023-08-31T00:25:57.420 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-08-31 00:22:51.206882666 +0000 2023-08-31T00:25:57.420 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-08-31T00:25:57.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T00:25:57.484 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-08-31T00:25:57.484 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-08-31T00:25:57.484 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000236765 s, 2.2 MB/s 2023-08-31T00:25:57.485 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T00:25:57.543 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2023-08-31T00:25:57.600 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T00:25:57.600 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:57.600 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 6h/6d Inode: 392388 Links: 1 2023-08-31T00:25:57.601 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:57.601 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:57.601 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-08-31 00:25:34.609615134 +0000 2023-08-31T00:25:57.601 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-08-31 00:22:51.719871667 +0000 2023-08-31T00:25:57.601 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-08-31 00:22:51.719871667 +0000 2023-08-31T00:25:57.602 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-08-31T00:25:57.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T00:25:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-08-31T00:25:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-08-31T00:25:57.665 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000192465 s, 2.7 MB/s 2023-08-31T00:25:57.666 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T00:25:57.724 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T00:25:57.724 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:57.724 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T00:25:57.743 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T00:25:57.744 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2023-08-31T00:25:57.802 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T00:25:57.805 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:57.805 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 387809 Links: 1 2023-08-31T00:25:57.805 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:57.806 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:57.806 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-08-31 00:25:42.543226176 +0000 2023-08-31T00:25:57.806 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-08-31 00:22:56.860853833 +0000 2023-08-31T00:25:57.806 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-08-31 00:22:56.860853833 +0000 2023-08-31T00:25:57.806 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-08-31T00:25:57.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T00:25:57.870 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-08-31T00:25:57.870 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-08-31T00:25:57.871 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000247458 s, 2.1 MB/s 2023-08-31T00:25:57.873 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T00:25:57.932 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2023-08-31T00:25:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T00:25:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 391332 Links: 1 2023-08-31T00:25:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-08-31 00:25:42.543226176 +0000 2023-08-31T00:25:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-08-31 00:22:57.350843654 +0000 2023-08-31T00:25:57.993 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-08-31 00:22:57.350843654 +0000 2023-08-31T00:25:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-08-31T00:25:57.993 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T00:25:58.058 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-08-31T00:25:58.058 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-08-31T00:25:58.058 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000232706 s, 2.2 MB/s 2023-08-31T00:25:58.059 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T00:25:58.118 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2023-08-31T00:25:58.177 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T00:25:58.177 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:58.177 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 392717 Links: 1 2023-08-31T00:25:58.178 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:58.178 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:58.178 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-08-31 00:25:42.543226176 +0000 2023-08-31T00:25:58.178 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-08-31 00:22:57.852833227 +0000 2023-08-31T00:25:58.178 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-08-31 00:22:57.852833227 +0000 2023-08-31T00:25:58.179 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-08-31T00:25:58.179 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T00:25:58.244 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-08-31T00:25:58.244 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-08-31T00:25:58.244 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000277568 s, 1.8 MB/s 2023-08-31T00:25:58.245 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T00:25:58.303 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2023-08-31T00:25:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T00:25:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T00:25:58.361 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 390481 Links: 1 2023-08-31T00:25:58.361 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T00:25:58.362 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T00:25:58.362 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-08-31 00:25:42.543226176 +0000 2023-08-31T00:25:58.362 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-08-31 00:22:58.359822696 +0000 2023-08-31T00:25:58.363 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-08-31 00:22:58.359822696 +0000 2023-08-31T00:25:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-08-31T00:25:58.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T00:25:58.427 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-08-31T00:25:58.427 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-08-31T00:25:58.428 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000192542 s, 2.7 MB/s 2023-08-31T00:25:58.429 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T00:25:58.487 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T00:25:58.487 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T00:25:58.488 INFO:tasks.ceph:Generating config... 2023-08-31T00:25:58.489 INFO:tasks.ceph:[client] pid file = 2023-08-31T00:25:58.489 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-31T00:25:58.490 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-31T00:25:58.490 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-31T00:25:58.490 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-31T00:25:58.490 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-31T00:25:58.491 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-31T00:25:58.491 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-31T00:25:58.491 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-31T00:25:58.491 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-31T00:25:58.492 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-31T00:25:58.492 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-31T00:25:58.492 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-31T00:25:58.492 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-31T00:25:58.493 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-31T00:25:58.493 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-31T00:25:58.493 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-31T00:25:58.494 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-31T00:25:58.494 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-31T00:25:58.494 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-31T00:25:58.494 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-31T00:25:58.495 INFO:tasks.ceph:Setting up mon.a... 2023-08-31T00:25:58.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-31T00:25:58.560 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2023-08-31T00:25:58.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-31T00:25:58.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T00:25:58.638 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.139'), ('mon.c', '[v2:172.21.15.139:3301,v1:172.21.15.139:6790]')] 2023-08-31T00:25:58.638 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-08-31T00:25:58.639 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:58.640 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T00:25:58.695 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.139 --addv c '[v2:172.21.15.139:3301,v1:172.21.15.139:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:25:58.783 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:25:58.783 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid cd1ac960-5b19-4e71-9e49-9da190b0a8ec 2023-08-31T00:25:58.784 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = pacific 2023-08-31T00:25:58.784 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2023-08-31T00:25:58.784 INFO:teuthology.orchestra.run.smithi077.stdout:fsid cd1ac960-5b19-4e71-9e49-9da190b0a8ec 2023-08-31T00:25:58.784 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2023-08-31T00:25:58.784254+0000 2023-08-31T00:25:58.784 INFO:teuthology.orchestra.run.smithi077.stdout:created 2023-08-31T00:25:58.784254+0000 2023-08-31T00:25:58.785 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 16 (pacific) 2023-08-31T00:25:58.785 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2023-08-31T00:25:58.785 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2023-08-31T00:25:58.785 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2023-08-31T00:25:58.785 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] mon.c 2023-08-31T00:25:58.785 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-31T00:25:58.787 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T00:25:58.803 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cd1ac960-5b19-4e71-9e49-9da190b0a8ec... 2023-08-31T00:25:58.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T00:25:58.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T00:25:58.888 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2023-08-31T00:25:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2023-08-31T00:25:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T00:25:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2023-08-31T00:25:58.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.889 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2023-08-31T00:25:58.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.889 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2023-08-31T00:25:58.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.890 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2023-08-31T00:25:58.890 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2023-08-31T00:25:58.890 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.890 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2023-08-31T00:25:58.890 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2023-08-31T00:25:58.891 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.891 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T00:25:58.891 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2023-08-31T00:25:58.891 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.892 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T00:25:58.892 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T00:25:58.892 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.892 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2023-08-31T00:25:58.892 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.893 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2023-08-31T00:25:58.893 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2023-08-31T00:25:58.893 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2023-08-31T00:25:58.893 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2023-08-31T00:25:58.893 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2023-08-31T00:25:58.893 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2023-08-31T00:25:58.894 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2023-08-31T00:25:58.894 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T00:25:58.894 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T00:25:58.894 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2023-08-31T00:25:58.894 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.895 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-31T00:25:58.895 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.895 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2023-08-31T00:25:58.895 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.896 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2023-08-31T00:25:58.896 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.896 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2023-08-31T00:25:58.896 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2023-08-31T00:25:58.896 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2023-08-31T00:25:58.897 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]" 2023-08-31T00:25:58.897 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = cd1ac960-5b19-4e71-9e49-9da190b0a8ec 2023-08-31T00:25:58.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.897 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2023-08-31T00:25:58.897 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2023-08-31T00:25:58.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.898 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2023-08-31T00:25:58.898 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2023-08-31T00:25:58.898 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2023-08-31T00:25:58.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.899 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2023-08-31T00:25:58.899 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2023-08-31T00:25:58.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.899 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2023-08-31T00:25:58.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2023-08-31T00:25:58.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2023-08-31T00:25:58.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2023-08-31T00:25:58.900 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2023-08-31T00:25:58.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2023-08-31T00:25:58.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.901 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2023-08-31T00:25:58.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.901 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2023-08-31T00:25:58.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.902 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2023-08-31T00:25:58.902 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2023-08-31T00:25:58.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.902 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2023-08-31T00:25:58.903 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2023-08-31T00:25:58.903 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2023-08-31T00:25:58.903 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2023-08-31T00:25:58.903 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2023-08-31T00:25:58.903 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2023-08-31T00:25:58.904 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2023-08-31T00:25:58.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2023-08-31T00:25:58.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2023-08-31T00:25:58.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-08-31T00:25:58.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2023-08-31T00:25:58.904 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2023-08-31T00:25:58.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T00:25:58.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2023-08-31T00:25:58.905 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2023-08-31T00:25:58.905 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2023-08-31T00:25:58.905 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2023-08-31T00:25:58.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.906 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2023-08-31T00:25:58.906 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-08-31T00:25:58.906 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2023-08-31T00:25:58.906 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-08-31T00:25:58.906 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-08-31T00:25:58.907 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-08-31T00:25:58.907 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-08-31T00:25:58.907 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2023-08-31T00:25:58.907 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.907 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2023-08-31T00:25:58.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-08-31T00:25:58.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-08-31T00:25:58.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2023-08-31T00:25:58.908 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-08-31T00:25:58.908 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2023-08-31T00:25:58.909 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2023-08-31T00:25:58.909 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-08-31T00:25:58.909 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2023-08-31T00:25:58.909 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2023-08-31T00:25:58.909 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-08-31T00:25:58.910 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.910 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T00:25:58.910 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T00:25:58.910 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T00:25:58.910 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.911 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T00:25:58.911 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T00:25:58.911 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T00:25:58.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.911 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2023-08-31T00:25:58.912 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2023-08-31T00:25:58.912 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.912 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2023-08-31T00:25:58.912 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:25:58.912 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2023-08-31T00:25:58.913 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2023-08-31T00:25:58.913 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2023-08-31T00:25:58.913 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2023-08-31T00:25:58.913 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T00:25:58.913 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T00:25:58.913 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2023-08-31T00:25:58.914 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2023-08-31T00:25:58.914 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2023-08-31T00:25:58.914 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2023-08-31T00:25:58.914 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-08-31T00:25:58.914 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-08-31T00:25:58.915 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-08-31T00:25:58.915 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-08-31T00:25:58.916 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2023-08-31T00:25:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2023-08-31T00:25:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T00:25:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2023-08-31T00:25:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2023-08-31T00:25:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2023-08-31T00:25:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2023-08-31T00:25:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2023-08-31T00:25:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2023-08-31T00:25:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2023-08-31T00:25:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T00:25:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2023-08-31T00:25:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T00:25:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T00:25:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2023-08-31T00:25:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2023-08-31T00:25:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2023-08-31T00:25:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2023-08-31T00:25:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2023-08-31T00:25:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2023-08-31T00:25:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2023-08-31T00:25:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2023-08-31T00:25:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T00:25:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T00:25:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2023-08-31T00:25:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-31T00:25:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2023-08-31T00:25:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2023-08-31T00:25:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2023-08-31T00:25:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2023-08-31T00:25:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2023-08-31T00:25:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.77,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]" 2023-08-31T00:25:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = cd1ac960-5b19-4e71-9e49-9da190b0a8ec 2023-08-31T00:25:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.925 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2023-08-31T00:25:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2023-08-31T00:25:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2023-08-31T00:25:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2023-08-31T00:25:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2023-08-31T00:25:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2023-08-31T00:25:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2023-08-31T00:25:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2023-08-31T00:25:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2023-08-31T00:25:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2023-08-31T00:25:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2023-08-31T00:25:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2023-08-31T00:25:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2023-08-31T00:25:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2023-08-31T00:25:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2023-08-31T00:25:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2023-08-31T00:25:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2023-08-31T00:25:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2023-08-31T00:25:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2023-08-31T00:25:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: bdev async discard = True 2023-08-31T00:25:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: bdev enable discard = True 2023-08-31T00:25:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore allocator = bitmap 2023-08-31T00:25:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2023-08-31T00:25:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2023-08-31T00:25:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 1/20 2023-08-31T00:25:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 1/20 2023-08-31T00:25:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-08-31T00:25:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2023-08-31T00:25:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 4/10 2023-08-31T00:25:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T00:25:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2023-08-31T00:25:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2023-08-31T00:25:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2023-08-31T00:25:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2023-08-31T00:25:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.933 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2023-08-31T00:25:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-08-31T00:25:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2023-08-31T00:25:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2023-08-31T00:25:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2023-08-31T00:25:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2023-08-31T00:25:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2023-08-31T00:25:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2023-08-31T00:25:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.935 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2023-08-31T00:25:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2023-08-31T00:25:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2023-08-31T00:25:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2023-08-31T00:25:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2023-08-31T00:25:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2023-08-31T00:25:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2023-08-31T00:25:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2023-08-31T00:25:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2023-08-31T00:25:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2023-08-31T00:25:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2023-08-31T00:25:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T00:25:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T00:25:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T00:25:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T00:25:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T00:25:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T00:25:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2023-08-31T00:25:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2023-08-31T00:25:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2023-08-31T00:25:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-08-31T00:25:58.940 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2023-08-31T00:25:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2023-08-31T00:25:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2023-08-31T00:25:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2023-08-31T00:25:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T00:25:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T00:25:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = "" 2023-08-31T00:25:58.941 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2023-08-31T00:25:58.941 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2023-08-31T00:25:58.942 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2023-08-31T00:25:58.942 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2023-08-31T00:25:58.942 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2023-08-31T00:25:58.942 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2023-08-31T00:25:58.942 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2023-08-31T00:25:58.943 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-31T00:25:58.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-31T00:25:59.015 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-31T00:25:59.016 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:59.016 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-31T00:25:59.033 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:59.033 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-31T00:25:59.089 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:25:59.090 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:59.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T00:25:59.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T00:25:59.187 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:25:59.187 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:25:59.367 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:25:59.368 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:59.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T00:25:59.369 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T00:25:59.412 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:25:59.412 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:25:59.471 INFO:tasks.ceph:Setting up mon nodes... 2023-08-31T00:25:59.472 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-31T00:25:59.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T00:25:59.527 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T00:25:59.529 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T00:25:59.620 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T00:25:59.623 INFO:tasks.ceph:Setting up mds nodes... 2023-08-31T00:25:59.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T00:25:59.677 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T00:25:59.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-31T00:25:59.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T00:25:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T00:25:59.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-31T00:25:59.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T00:25:59.888 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T00:25:59.891 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-31T00:25:59.919 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T00:26:00.014 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T00:26:00.016 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-31T00:26:00.042 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-31T00:26:00.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-31T00:26:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-31T00:26:00.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-31T00:26:00.182 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-31T00:26:00.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-31T00:26:00.238 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-31T00:26:00.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-31T00:26:00.294 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-31T00:26:00.307 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-31T00:26:00.307 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T00:26:00.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-31T00:26:00.335 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:00.336 INFO:tasks.ceph:role: osd.0 2023-08-31T00:26:00.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:26:00.336 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T00:26:00.408 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:00.409 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:00.409 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:00.409 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:00.409 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:00.410 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:00.410 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:00.410 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:00.410 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:00.410 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:00.853 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-08-31T00:26:00.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-08-31T00:26:00.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-31T00:26:01.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-31T00:26:01.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-31T00:26:01.139 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:01.139 INFO:tasks.ceph:role: osd.1 2023-08-31T00:26:01.140 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:26:01.140 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T00:26:01.213 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:01.213 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:01.213 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:01.213 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:01.214 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:01.214 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:01.214 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:01.214 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:01.214 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:01.215 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:01.631 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-08-31T00:26:01.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-08-31T00:26:01.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-31T00:26:01.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-31T00:26:01.777 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-31T00:26:01.843 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:01.844 INFO:tasks.ceph:role: osd.2 2023-08-31T00:26:01.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:26:01.844 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T00:26:01.917 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:01.917 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:01.917 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:01.918 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:01.918 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:01.919 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:01.919 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:01.919 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:01.919 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:01.919 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:02.358 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-08-31T00:26:02.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-08-31T00:26:02.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-31T00:26:02.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-31T00:26:02.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-31T00:26:02.638 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:02.638 INFO:tasks.ceph:role: osd.3 2023-08-31T00:26:02.639 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:26:02.639 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T00:26:02.711 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:02.712 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:02.712 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:02.712 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:02.712 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:02.712 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:02.713 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:02.713 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:02.713 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:02.713 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:03.144 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2023-08-31T00:26:03.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-08-31T00:26:03.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-31T00:26:03.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-31T00:26:03.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:03.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:03.453+0000 7fce81ea1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-31T00:26:03.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:03.453+0000 7fce81ea1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-31T00:26:03.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:03.453+0000 7fce81ea1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T00:26:03.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:03.453+0000 7fce81ea1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T00:26:03.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:03.453+0000 7fce81ea1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T00:26:03.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:03.454+0000 7fce81ea1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-31T00:26:06.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-31T00:26:06.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:06.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:06.447+0000 7fb83b53f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-31T00:26:06.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:06.447+0000 7fb83b53f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-31T00:26:06.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:06.448+0000 7fb83b53f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T00:26:06.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:06.448+0000 7fb83b53f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T00:26:06.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:06.448+0000 7fb83b53f640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T00:26:06.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:06.448+0000 7fb83b53f640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-31T00:26:09.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-31T00:26:09.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:09.437+0000 7f27c0c37640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-31T00:26:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:09.437+0000 7f27c0c37640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-31T00:26:09.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:09.437+0000 7f27c0c37640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T00:26:09.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:09.437+0000 7f27c0c37640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T00:26:09.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:09.437+0000 7f27c0c37640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T00:26:09.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:09.437+0000 7f27c0c37640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-31T00:26:12.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-31T00:26:12.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:12.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:12.424+0000 7f89fb413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-31T00:26:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:12.425+0000 7f89fb413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-31T00:26:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:12.425+0000 7f89fb413640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T00:26:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:12.425+0000 7f89fb413640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T00:26:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:12.425+0000 7f89fb413640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T00:26:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:12.425+0000 7f89fb413640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-31T00:26:15.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-31T00:26:15.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-31T00:26:15.355 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:15.355 INFO:tasks.ceph:role: osd.4 2023-08-31T00:26:15.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:26:15.356 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T00:26:15.433 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:15.433 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:15.434 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:15.434 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:15.434 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:15.434 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:15.434 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:15.435 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:15.435 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:15.435 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:15.870 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2023-08-31T00:26:15.872 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2023-08-31T00:26:15.873 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-31T00:26:16.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-31T00:26:16.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-31T00:26:16.163 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:16.164 INFO:tasks.ceph:role: osd.5 2023-08-31T00:26:16.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:26:16.164 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T00:26:16.241 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:16.242 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:16.243 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:16.243 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:16.243 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:16.662 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2023-08-31T00:26:16.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2023-08-31T00:26:16.664 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-31T00:26:16.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-31T00:26:16.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-31T00:26:16.890 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:16.891 INFO:tasks.ceph:role: osd.6 2023-08-31T00:26:16.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:26:16.891 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T00:26:16.967 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:16.968 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:16.968 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:16.968 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:16.969 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:17.417 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2023-08-31T00:26:17.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2023-08-31T00:26:17.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-31T00:26:17.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-31T00:26:17.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-31T00:26:17.689 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T00:26:17.689 INFO:tasks.ceph:role: osd.7 2023-08-31T00:26:17.690 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:26:17.690 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T00:26:17.765 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T00:26:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T00:26:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T00:26:17.766 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T00:26:17.767 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T00:26:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2023-08-31T00:26:17.767 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T00:26:17.767 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T00:26:17.767 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T00:26:17.768 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T00:26:18.198 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2023-08-31T00:26:18.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2023-08-31T00:26:18.200 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-31T00:26:18.351 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-31T00:26:18.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:18.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:18.496+0000 7faa99ac1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-31T00:26:18.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:18.496+0000 7faa99ac1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-31T00:26:18.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:18.496+0000 7faa99ac1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T00:26:18.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:18.496+0000 7faa99ac1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T00:26:18.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:18.496+0000 7faa99ac1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T00:26:18.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:18.497+0000 7faa99ac1640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-31T00:26:21.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-31T00:26:21.400 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:21.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:21.490+0000 7f76f6c2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-31T00:26:21.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:21.490+0000 7f76f6c2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-31T00:26:21.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:21.490+0000 7f76f6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T00:26:21.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:21.490+0000 7f76f6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T00:26:21.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:21.490+0000 7f76f6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T00:26:21.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:21.490+0000 7f76f6c2c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-31T00:26:24.369 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-31T00:26:24.400 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:24.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:24.490+0000 7f43aa50c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-31T00:26:24.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:24.490+0000 7f43aa50c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-31T00:26:24.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:24.490+0000 7f43aa50c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T00:26:24.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:24.490+0000 7f43aa50c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T00:26:24.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:24.490+0000 7f43aa50c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T00:26:24.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:24.490+0000 7f43aa50c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-31T00:26:26.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:26:26.866 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:26:27.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-31T00:26:27.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:27.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:27.487+0000 7fea6ba58640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-31T00:26:27.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:27.488+0000 7fea6ba58640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-31T00:26:27.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:27.488+0000 7fea6ba58640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T00:26:27.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:27.488+0000 7fea6ba58640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T00:26:27.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:27.488+0000 7fea6ba58640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T00:26:27.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:27.488+0000 7fea6ba58640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-31T00:26:30.352 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-31T00:26:30.383 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-31T00:26:30.384 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-31T00:26:30.416 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-31T00:26:30.488 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-31T00:26:30.558 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-31T00:26:30.627 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-31T00:26:30.696 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-31T00:26:30.764 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:30.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-31T00:26:30.831 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:30.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-31T00:26:30.864 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:30.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-31T00:26:30.935 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:30.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-31T00:26:31.003 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:31.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-31T00:26:31.072 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:31.073 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-31T00:26:31.141 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:31.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-31T00:26:31.209 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:31.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-31T00:26:31.276 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:31.276 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-31T00:26:31.296 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:31.296 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-31T00:26:31.355 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:31.356 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-31T00:26:31.373 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:31.374 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-31T00:26:31.434 INFO:tasks.ceph:Adding keys to all mons... 2023-08-31T00:26:31.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T00:26:31.437 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T00:26:31.478 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2023-08-31T00:26:31.478 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAX3u9km/52HxAAxU/jjzsDmqrykxB4ZFjs9w== 2023-08-31T00:26:31.478 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-08-31T00:26:31.479 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAX3u9kqxpyKBAA/6egwjMwFfXcQytWOSNTyw== 2023-08-31T00:26:31.479 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-08-31T00:26:31.479 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAX3u9kBdGmLxAA+xN2F5Mt/obBMLNEymC+LA== 2023-08-31T00:26:31.479 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2023-08-31T00:26:31.479 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAb3u9kUkIKGxAAfqdXjd28aOPANxQ0svI6Hg== 2023-08-31T00:26:31.480 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2023-08-31T00:26:31.480 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAe3u9k5NbCGhAA3z4sr3l/ikxtffx3N90+6A== 2023-08-31T00:26:31.480 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2023-08-31T00:26:31.480 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAh3u9kDfggGhAA87dWe+8rfP4a2VhAsqupjg== 2023-08-31T00:26:31.481 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2023-08-31T00:26:31.481 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAk3u9kuY5jGRAAu87fmHrPNQ4kzHtiMhIw7Q== 2023-08-31T00:26:31.481 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2023-08-31T00:26:31.481 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAX3u9kig8OJRAAqwQTOU8YgLx/rg1ZBe5wBw== 2023-08-31T00:26:31.481 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-08-31T00:26:31.482 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAX3u9kn+b/NBAAlhUQVatTMWdmN77oYIZ4Vg== 2023-08-31T00:26:31.482 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-08-31T00:26:31.482 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAY3u9khlHhABAALSUioSVCXTsY0L3wwbskQg== 2023-08-31T00:26:31.482 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2023-08-31T00:26:31.482 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAq3u9kGKSuHRAAoVa8AHz0DVkCOpnFujAPpg== 2023-08-31T00:26:31.483 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2023-08-31T00:26:31.483 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAt3u9k/nNKHRAApU+u4tll+tAuh++ywyb1mQ== 2023-08-31T00:26:31.483 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2023-08-31T00:26:31.483 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAw3u9kOpFMHRAAQFx8VIcNtkcy02NWQRHM6g== 2023-08-31T00:26:31.484 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2023-08-31T00:26:31.484 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAz3u9kHiIZHRAAeCZYFSTt4hve9iA8n8Q1nA== 2023-08-31T00:26:31.484 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-08-31T00:26:31.484 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAY3u9kZfM5BRAA3ct45RKE/VpmqgPOlkxNtQ== 2023-08-31T00:26:31.484 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2023-08-31T00:26:31.485 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAY3u9kzr/pChAAAGlha/S2piFWL4+Ywj9KNw== 2023-08-31T00:26:31.485 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2023-08-31T00:26:31.485 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAY3u9kaWpJDhAAtXMXV8RA9XXr0X44O6arOA== 2023-08-31T00:26:31.485 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2023-08-31T00:26:31.485 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAY3u9kPzKbERAAUCQS5+7fZIoc0ZH1na3LzA== 2023-08-31T00:26:31.500 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2023-08-31T00:26:31.501 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAX3u9km/52HxAAxU/jjzsDmqrykxB4ZFjs9w== 2023-08-31T00:26:31.501 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2023-08-31T00:26:31.501 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAX3u9kqxpyKBAA/6egwjMwFfXcQytWOSNTyw== 2023-08-31T00:26:31.501 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2023-08-31T00:26:31.502 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAX3u9kBdGmLxAA+xN2F5Mt/obBMLNEymC+LA== 2023-08-31T00:26:31.502 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2023-08-31T00:26:31.502 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAb3u9kUkIKGxAAfqdXjd28aOPANxQ0svI6Hg== 2023-08-31T00:26:31.502 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2023-08-31T00:26:31.502 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAe3u9k5NbCGhAA3z4sr3l/ikxtffx3N90+6A== 2023-08-31T00:26:31.503 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2023-08-31T00:26:31.503 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAh3u9kDfggGhAA87dWe+8rfP4a2VhAsqupjg== 2023-08-31T00:26:31.503 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2023-08-31T00:26:31.503 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAk3u9kuY5jGRAAu87fmHrPNQ4kzHtiMhIw7Q== 2023-08-31T00:26:31.503 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2023-08-31T00:26:31.503 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAX3u9kig8OJRAAqwQTOU8YgLx/rg1ZBe5wBw== 2023-08-31T00:26:31.504 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2023-08-31T00:26:31.504 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAX3u9kn+b/NBAAlhUQVatTMWdmN77oYIZ4Vg== 2023-08-31T00:26:31.504 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2023-08-31T00:26:31.504 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAY3u9khlHhABAALSUioSVCXTsY0L3wwbskQg== 2023-08-31T00:26:31.504 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2023-08-31T00:26:31.505 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAq3u9kGKSuHRAAoVa8AHz0DVkCOpnFujAPpg== 2023-08-31T00:26:31.505 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2023-08-31T00:26:31.505 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAt3u9k/nNKHRAApU+u4tll+tAuh++ywyb1mQ== 2023-08-31T00:26:31.505 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2023-08-31T00:26:31.505 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAw3u9kOpFMHRAAQFx8VIcNtkcy02NWQRHM6g== 2023-08-31T00:26:31.506 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2023-08-31T00:26:31.506 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAz3u9kHiIZHRAAeCZYFSTt4hve9iA8n8Q1nA== 2023-08-31T00:26:31.506 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2023-08-31T00:26:31.506 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAY3u9kZfM5BRAA3ct45RKE/VpmqgPOlkxNtQ== 2023-08-31T00:26:31.506 INFO:teuthology.orchestra.run.smithi139.stdout:[client.2] 2023-08-31T00:26:31.506 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAY3u9kzr/pChAAAGlha/S2piFWL4+Ywj9KNw== 2023-08-31T00:26:31.507 INFO:teuthology.orchestra.run.smithi139.stdout:[client.1] 2023-08-31T00:26:31.507 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAY3u9kaWpJDhAAtXMXV8RA9XXr0X44O6arOA== 2023-08-31T00:26:31.507 INFO:teuthology.orchestra.run.smithi139.stdout:[client.3] 2023-08-31T00:26:31.507 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAY3u9kPzKbERAAUCQS5+7fZIoc0ZH1na3LzA== 2023-08-31T00:26:31.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T00:26:31.528 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T00:26:31.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:31.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:31.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:31.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:31.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.835 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:31.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T00:26:31.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T00:26:31.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:32.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:32.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:32.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T00:26:32.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T00:26:32.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.342 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.400 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T00:26:32.574 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-31T00:26:32.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-31T00:26:32.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T00:26:32.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-31T00:26:32.730 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-31T00:26:32.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T00:26:32.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-31T00:26:32.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-31T00:26:32.947 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T00:26:33.047 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-31T00:26:33.074 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:33.077 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T00:26:33.130 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-31T00:26:33.131 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-31T00:26:33.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-31T00:26:33.134 INFO:tasks.ceph.mon.a:Started 2023-08-31T00:26:33.134 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-31T00:26:33.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-31T00:26:33.173 INFO:tasks.ceph.mon.b:Started 2023-08-31T00:26:33.173 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-31T00:26:33.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-31T00:26:33.175 INFO:tasks.ceph.mon.c:Started 2023-08-31T00:26:33.176 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client mount timeout', '600'] 2023-08-31T00:26:33.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set client 'client mount timeout' 600 2023-08-31T00:26:33.178 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug client', '20'] 2023-08-31T00:26:33.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set client 'debug client' 20 2023-08-31T00:26:33.222 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug ms', '1'] 2023-08-31T00:26:33.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set client 'debug ms' 1 2023-08-31T00:26:33.265 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados mon op timeout', '900'] 2023-08-31T00:26:33.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set client 'rados mon op timeout' 900 2023-08-31T00:26:33.308 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados osd op timeout', '900'] 2023-08-31T00:26:33.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set client 'rados osd op timeout' 900 2023-08-31T00:26:33.353 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug mds', '20'] 2023-08-31T00:26:33.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'debug mds' 20 2023-08-31T00:26:33.397 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug mds balancer', '20'] 2023-08-31T00:26:33.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'debug mds balancer' 20 2023-08-31T00:26:33.441 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug ms', '1'] 2023-08-31T00:26:33.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'debug ms' 1 2023-08-31T00:26:33.485 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal fragment size max', '10000'] 2023-08-31T00:26:33.485 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds bal fragment size max' 10000 2023-08-31T00:26:33.535 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal merge size', '5'] 2023-08-31T00:26:33.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds bal merge size' 5 2023-08-31T00:26:33.588 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal split bits', '3'] 2023-08-31T00:26:33.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds bal split bits' 3 2023-08-31T00:26:33.637 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal split size', '100'] 2023-08-31T00:26:33.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds bal split size' 100 2023-08-31T00:26:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.636+0000 7f62202a2700 1 -- 172.21.15.77:0/956048729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f621815a380 msgr2=0x7f62181566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.636+0000 7f62202a2700 1 --2- 172.21.15.77:0/956048729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f621815a380 0x7f62181566f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f620800d5c0 tx=0x7f62080047c0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.634+0000 7f6ec538b700 1 -- 172.21.15.77:0/64938767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=client mount timeout}] v 0) v1 -- 0x7f6ec00c9ee0 con 0x7f6ea8004850 2023-08-31T00:26:33.641 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds debug frag', 'True'] 2023-08-31T00:26:33.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds debug frag' True 2023-08-31T00:26:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.646+0000 7f62202a2700 1 -- 172.21.15.77:0/956048729 shutdown_connections 2023-08-31T00:26:33.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.646+0000 7f62202a2700 1 --2- 172.21.15.77:0/956048729 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f62181fe5c0 0x7f6218156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.646+0000 7f62202a2700 1 --2- 172.21.15.77:0/956048729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6204004850 0x7f62181f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.646+0000 7f62202a2700 1 --2- 172.21.15.77:0/956048729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f621815a380 0x7f62181566f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.646+0000 7f62202a2700 1 -- 172.21.15.77:0/956048729 >> 172.21.15.77:0/956048729 conn(0x7f6218070270 msgr2=0x7f62180ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.667 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds debug scatterstat', 'True'] 2023-08-31T00:26:33.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds debug scatterstat' True 2023-08-31T00:26:33.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.654+0000 7f6ea77fe700 1 -- 172.21.15.77:0/64938767 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f6eb000f880 con 0x7f6ea8004850 2023-08-31T00:26:33.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.654+0000 7f6ea77fe700 1 -- 172.21.15.77:0/64938767 <== mon.0 v2:172.21.15.77:3300/0 9 ==== mon_command_ack([{prefix=config set, name=client mount timeout}]=0 v3)=0 v3) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6eb000fb50 con 0x7f6ea8004850 2023-08-31T00:26:33.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 -- 172.21.15.77:0/64938767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8004850 msgr2=0x7f6ec00c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 --2- 172.21.15.77:0/64938767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8004850 0x7f6ec00c3870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d660 tx=0x7f6eb000da20 comp rx=0 tx=0).stop 2023-08-31T00:26:33.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 -- 172.21.15.77:0/64938767 shutdown_connections 2023-08-31T00:26:33.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 --2- 172.21.15.77:0/64938767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ec00ae8b0 0x7f6ec00c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 --2- 172.21.15.77:0/64938767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ea8004850 0x7f6ec00c3870 secure :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d660 tx=0x7f6eb000da20 comp rx=0 tx=0).stop 2023-08-31T00:26:33.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 --2- 172.21.15.77:0/64938767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ec0153e80 0x7f6ec00ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f6ec538b700 1 -- 172.21.15.77:0/64938767 >> 172.21.15.77:0/64938767 conn(0x7f6ec0070270 msgr2=0x7f6ec00b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.656+0000 7f6f09ffb700 1 -- 172.21.15.77:0/1784248380 <== mon.2 v2:172.21.15.139:3301/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f6f040103c0 con 0x7f6f141f49c0 2023-08-31T00:26:33.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.662+0000 7f6f1b2e9700 1 -- 172.21.15.77:0/1784248380 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=debug client}] v 0) v1 -- 0x7f6eec005140 con 0x7f6f141f49c0 2023-08-31T00:26:33.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.652+0000 7f62202a2700 1 -- 172.21.15.77:0/956048729 shutdown_connections 2023-08-31T00:26:33.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.654+0000 7f62202a2700 1 -- 172.21.15.77:0/956048729 wait complete. 2023-08-31T00:26:33.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.652+0000 7fc7a771b700 1 -- 172.21.15.77:0/4086630415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=rados mon op timeout}] v 0) v1 -- 0x7fc780000e80 con 0x7fc7a00b21c0 2023-08-31T00:26:33.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.653+0000 7fc795ffb700 1 -- 172.21.15.77:0/4086630415 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fc790004fe0 con 0x7fc7a00b21c0 2023-08-31T00:26:33.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.652+0000 7fe86d7fa700 1 -- 172.21.15.77:0/1230926865 <== mon.1 v2:172.21.15.139:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fe864004dc0 con 0x7fe870155ba0 2023-08-31T00:26:33.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.654+0000 7fd2897fa700 1 -- 172.21.15.77:0/3150785358 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fd280010aa0 con 0x7fd28c0c9ef0 2023-08-31T00:26:33.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.655+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/935940387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040c9ef0 msgr2=0x7f5a040715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.655+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/935940387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040c9ef0 0x7f5a040715c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a00005fd0 tx=0x7f5a00009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:33.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.663+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/935940387 shutdown_connections 2023-08-31T00:26:33.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.663+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/935940387 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9b10 0x7f5a040cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.663+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/935940387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a040c9ef0 0x7f5a040715c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.663+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/935940387 >> 172.21.15.77:0/935940387 conn(0x7f5a0406a4d0 msgr2=0x7f5a040aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/935940387 shutdown_connections 2023-08-31T00:26:33.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.664+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/935940387 wait complete. 2023-08-31T00:26:33.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.665+0000 7f5a0bd2a700 1 Processor -- start 2023-08-31T00:26:33.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.665+0000 7f5a0bd2a700 1 -- start start 2023-08-31T00:26:33.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.666+0000 7f5a0bd2a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 0x7f5a04151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.666+0000 7f5a0bd2a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 0x7f5a04145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.666+0000 7f5a0bd2a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a0415f0e0 0x7f5a041521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.666+0000 7f5a0bd2a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04146380 con 0x7f5a0415f0e0 2023-08-31T00:26:33.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.666+0000 7f5a0bd2a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0415b6d0 con 0x7f5a040c9b10 2023-08-31T00:26:33.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.666+0000 7f5a0bd2a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0415b9b0 con 0x7f5a040c9ef0 2023-08-31T00:26:33.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a09ac6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 0x7f5a04151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 0x7f5a04145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 0x7f5a04145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:53478/0 (socket says 172.21.15.77:53478) 2023-08-31T00:26:33.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a09ac6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 0x7f5a04151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:49092/0 (socket says 172.21.15.77:49092) 2023-08-31T00:26:33.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 -- 172.21.15.77:0/779151199 learned_addr learned my addr 172.21.15.77:0/779151199 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:33.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f6ec538b700 1 -- 172.21.15.77:0/64938767 shutdown_connections 2023-08-31T00:26:33.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a0a2c7700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a0415f0e0 0x7f5a041521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 -- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 msgr2=0x7f5a04151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 0x7f5a04151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 -- 172.21.15.77:0/779151199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a0415f0e0 msgr2=0x7f5a041521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a0415f0e0 0x7f5a041521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a092c5700 1 -- 172.21.15.77:0/779151199 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000095f0 con 0x7f5a040c9ef0 2023-08-31T00:26:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.667+0000 7f5a0a2c7700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a0415f0e0 0x7f5a041521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f5a092c5700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 0x7f5a04145e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5a040afa90 tx=0x7f5a00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f5a09ac6700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 0x7f5a04151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:26:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f6ec538b700 1 -- 172.21.15.77:0/64938767 wait complete. 2023-08-31T00:26:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00004a30 con 0x7f5a040c9ef0 2023-08-31T00:26:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f5a00004b90 con 0x7f5a040c9ef0 2023-08-31T00:26:33.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00005020 con 0x7f5a040c9ef0 2023-08-31T00:26:33.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0415bc90 con 0x7f5a040c9ef0 2023-08-31T00:26:33.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.668+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0415c250 con 0x7f5a040c9ef0 2023-08-31T00:26:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.671+0000 7fd2897fa700 1 -- 172.21.15.77:0/3150785358 <== mon.0 v2:172.21.15.77:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7fd280010c10 con 0x7fd28c0c9ef0 2023-08-31T00:26:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.672+0000 7f6f09ffb700 1 -- 172.21.15.77:0/1784248380 <== mon.2 v2:172.21.15.139:3301/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f6f040105b0 con 0x7f6f141f49c0 2023-08-31T00:26:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.671+0000 7fc795ffb700 1 -- 172.21.15.77:0/4086630415 <== mon.0 v2:172.21.15.77:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7fc790011780 con 0x7fc7a00b21c0 2023-08-31T00:26:33.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.674+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a00005180 con 0x7f5a040c9ef0 2023-08-31T00:26:33.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.674+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5a00003a90 con 0x7f5a040c9ef0 2023-08-31T00:26:33.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.674+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 6 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7f5a00003d40 con 0x7f5a040c9ef0 2023-08-31T00:26:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.676+0000 7fe86d7fa700 1 -- 172.21.15.77:0/1230926865 <== mon.1 v2:172.21.15.139:3300/0 9 ==== config(3 keys) v1 ==== 85+0+0 (secure 0 0 0) 0x7fe86400e450 con 0x7fe870155ba0 2023-08-31T00:26:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.676+0000 7fe86d7fa700 1 -- 172.21.15.77:0/1230926865 <== mon.1 v2:172.21.15.139:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados osd op timeout}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe86400e6c0 con 0x7fe870155ba0 2023-08-31T00:26:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 -- 172.21.15.77:0/1230926865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe870155ba0 msgr2=0x7fe8700c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 --2- 172.21.15.77:0/1230926865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe870155ba0 0x7fe8700c6580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe864003cc0 tx=0x7fe86400fe50 comp rx=0 tx=0).stop 2023-08-31T00:26:33.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 -- 172.21.15.77:0/1230926865 shutdown_connections 2023-08-31T00:26:33.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 --2- 172.21.15.77:0/1230926865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe870155ba0 0x7fe8700c6580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 --2- 172.21.15.77:0/1230926865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8700668d0 0x7fe8701f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 --2- 172.21.15.77:0/1230926865 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe8700cde90 0x7fe870155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.679+0000 7fe876f6a700 1 -- 172.21.15.77:0/1230926865 >> 172.21.15.77:0/1230926865 conn(0x7fe8700cd370 msgr2=0x7fe870153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.680+0000 7fe876f6a700 1 -- 172.21.15.77:0/1230926865 shutdown_connections 2023-08-31T00:26:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.680+0000 7fe876f6a700 1 -- 172.21.15.77:0/1230926865 wait complete. 2023-08-31T00:26:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.683+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e00050e0 con 0x7f5a040c9ef0 2023-08-31T00:26:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.684+0000 7fc795ffb700 1 -- 172.21.15.77:0/4086630415 <== mon.0 v2:172.21.15.77:3300/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7fc790011970 con 0x7fc7a00b21c0 2023-08-31T00:26:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.684+0000 7fc795ffb700 1 -- 172.21.15.77:0/4086630415 <== mon.0 v2:172.21.15.77:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados mon op timeout}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc790011da0 con 0x7fc7a00b21c0 2023-08-31T00:26:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.684+0000 7fd2897fa700 1 -- 172.21.15.77:0/3150785358 <== mon.0 v2:172.21.15.77:3300/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7fd280010e20 con 0x7fd28c0c9ef0 2023-08-31T00:26:33.713 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds op complaint time', '180'] 2023-08-31T00:26:33.714 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds op complaint time' 180 2023-08-31T00:26:33.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.687+0000 7fc7a771b700 1 -- 172.21.15.77:0/4086630415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a00b21c0 msgr2=0x7fc7a00b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.687+0000 7fc7a771b700 1 --2- 172.21.15.77:0/4086630415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a00b21c0 0x7fc7a00b2640 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc790010a50 tx=0x7fc790010e10 comp rx=0 tx=0).stop 2023-08-31T00:26:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.687+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5a00030060 con 0x7f5a040c9ef0 2023-08-31T00:26:33.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.687+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 8 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7f5a00003680 con 0x7f5a040c9ef0 2023-08-31T00:26:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.690+0000 7f6f09ffb700 1 -- 172.21.15.77:0/1784248380 <== mon.2 v2:172.21.15.139:3301/0 10 ==== config(4 keys) v1 ==== 116+0+0 (secure 0 0 0) 0x7f6f04010860 con 0x7f6f141f49c0 2023-08-31T00:26:33.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 -- 172.21.15.77:0/4086630415 shutdown_connections 2023-08-31T00:26:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 --2- 172.21.15.77:0/4086630415 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc7a00cb400 0x7fc7a00cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 --2- 172.21.15.77:0/4086630415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc78c005210 0x7fc7a0156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 --2- 172.21.15.77:0/4086630415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7a00b21c0 0x7fc7a00b2640 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 -- 172.21.15.77:0/4086630415 >> 172.21.15.77:0/4086630415 conn(0x7fc7a0070270 msgr2=0x7fc7a00ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 -- 172.21.15.77:0/4086630415 shutdown_connections 2023-08-31T00:26:33.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.693+0000 7fc7a771b700 1 -- 172.21.15.77:0/4086630415 wait complete. 2023-08-31T00:26:33.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.717+0000 7fd2897fa700 1 -- 172.21.15.77:0/3150785358 <== mon.0 v2:172.21.15.77:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd280003ce0 con 0x7fd28c0c9ef0 2023-08-31T00:26:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.725+0000 7f6f09ffb700 1 -- 172.21.15.77:0/1784248380 <== mon.2 v2:172.21.15.139:3301/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f04010ae0 con 0x7f6f141f49c0 2023-08-31T00:26:33.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.725+0000 7f6f09ffb700 1 -- 172.21.15.77:0/1784248380 <== mon.2 v2:172.21.15.139:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug client}]=0 v6)=0 v6) v1 ==== 114+0+0 (secure 0 0 0) 0x7f6f04015070 con 0x7f6f141f49c0 2023-08-31T00:26:33.737 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds verify scatter', 'True'] 2023-08-31T00:26:33.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'mds verify scatter' True 2023-08-31T00:26:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.724+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 9 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5a00005610 con 0x7f5a040c9ef0 2023-08-31T00:26:33.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.737+0000 7f6f1b2e9700 1 -- 172.21.15.77:0/1784248380 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f141f49c0 msgr2=0x7f6f140c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.737+0000 7f6f1b2e9700 1 --2- 172.21.15.77:0/1784248380 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f141f49c0 0x7f6f140c6250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6f04000f60 tx=0x7f6f04003960 comp rx=0 tx=0).stop 2023-08-31T00:26:33.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.744+0000 7f6f1b2e9700 1 -- 172.21.15.77:0/1784248380 shutdown_connections 2023-08-31T00:26:33.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.744+0000 7f6f1b2e9700 1 --2- 172.21.15.77:0/1784248380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f140c7ab0 0x7f6f1406c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.744+0000 7f6f1b2e9700 1 --2- 172.21.15.77:0/1784248380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f00003a00 0x7f6f14158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.744+0000 7f6f1b2e9700 1 --2- 172.21.15.77:0/1784248380 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f141f49c0 0x7f6f140c6250 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.744+0000 7f6f1b2e9700 1 -- 172.21.15.77:0/1784248380 >> 172.21.15.77:0/1784248380 conn(0x7f6f140cf180 msgr2=0x7f6f140cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.749 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd op complaint time', '180'] 2023-08-31T00:26:33.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'osd op complaint time' 180 2023-08-31T00:26:33.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.745+0000 7f6f1b2e9700 1 -- 172.21.15.77:0/1784248380 shutdown_connections 2023-08-31T00:26:33.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.745+0000 7f6f1b2e9700 1 -- 172.21.15.77:0/1784248380 wait complete. 2023-08-31T00:26:33.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.757+0000 7fd2930af700 1 -- 172.21.15.77:0/3150785358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=debug mds}] v 0) v1 -- 0x7fd264005350 con 0x7fd28c0c9ef0 2023-08-31T00:26:33.765 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados mon op timeout', '900'] 2023-08-31T00:26:33.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'rados mon op timeout' 900 2023-08-31T00:26:33.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.776+0000 7fd2897fa700 1 -- 172.21.15.77:0/3150785358 <== mon.0 v2:172.21.15.77:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7fd2800290b0 con 0x7fd28c0c9ef0 2023-08-31T00:26:33.787 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados osd op timeout', '900'] 2023-08-31T00:26:33.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mds 'rados osd op timeout' 900 2023-08-31T00:26:33.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.785+0000 7fd2930af700 1 -- 172.21.15.77:0/3150785358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd28c0c9ef0 msgr2=0x7fd28c153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.785+0000 7fd2930af700 1 --2- 172.21.15.77:0/3150785358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd28c0c9ef0 0x7fd28c153a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd2800011e0 tx=0x7fd2800014f0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 -- 172.21.15.77:0/3150785358 shutdown_connections 2023-08-31T00:26:33.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 --2- 172.21.15.77:0/3150785358 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd28c15a230 0x7fd28c157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 --2- 172.21.15.77:0/3150785358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd28c0c9b10 0x7fd28c13cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 --2- 172.21.15.77:0/3150785358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd28c0c9ef0 0x7fd28c153a60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 -- 172.21.15.77:0/3150785358 >> 172.21.15.77:0/3150785358 conn(0x7fd28c06a4d0 msgr2=0x7fd28c150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 -- 172.21.15.77:0/3150785358 shutdown_connections 2023-08-31T00:26:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.788+0000 7fd2930af700 1 -- 172.21.15.77:0/3150785358 wait complete. 2023-08-31T00:26:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.795+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=debug mds balancer}] v 0) v1 -- 0x7f59e0005390 con 0x7f5a040c9ef0 2023-08-31T00:26:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.789+0000 7f3334810700 1 -- 172.21.15.77:0/2667110159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33300c9fb0 msgr2=0x7f33300cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.789+0000 7f3334810700 1 --2- 172.21.15.77:0/2667110159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33300c9fb0 0x7f33300cadb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33300ca680 tx=0x7f332800b330 comp rx=0 tx=0).stop 2023-08-31T00:26:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.796+0000 7f3334810700 1 -- 172.21.15.77:0/2667110159 shutdown_connections 2023-08-31T00:26:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.796+0000 7f3334810700 1 --2- 172.21.15.77:0/2667110159 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33300c9fb0 0x7f33300cadb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.796+0000 7f3334810700 1 --2- 172.21.15.77:0/2667110159 >> v2:172.21.15.139:3300/0 conn(0x7f333015b5e0 0x7f333015faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.796+0000 7f3334810700 1 -- 172.21.15.77:0/2667110159 >> 172.21.15.77:0/2667110159 conn(0x7f333006a4d0 msgr2=0x7f33300aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.800 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon op complaint time', '120'] 2023-08-31T00:26:33.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set mon 'mon op complaint time' 120 2023-08-31T00:26:33.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.801+0000 7f3334810700 1 -- 172.21.15.77:0/2667110159 shutdown_connections 2023-08-31T00:26:33.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.801+0000 7f3334810700 1 -- 172.21.15.77:0/2667110159 wait complete. 2023-08-31T00:26:33.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.804+0000 7f3334810700 1 Processor -- start 2023-08-31T00:26:33.820 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd op complaint time', '180'] 2023-08-31T00:26:33.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set osd 'osd op complaint time' 180 2023-08-31T00:26:33.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.805+0000 7f3334810700 1 -- start start 2023-08-31T00:26:33.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.806+0000 7f3334810700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 0x7f333006d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.806+0000 7f3334810700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333015b5e0 0x7f3330151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.806+0000 7f3334810700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f333015eda0 0x7f3330151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.806+0000 7f3334810700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333015f280 con 0x7f333015b5e0 2023-08-31T00:26:33.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.806+0000 7f3334810700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333006c5e0 con 0x7f33300c9fb0 2023-08-31T00:26:33.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.806+0000 7f3334810700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333006c8c0 con 0x7f333015eda0 2023-08-31T00:26:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 0x7f333006d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 0x7f333006d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:49104/0 (socket says 172.21.15.77:49104) 2023-08-31T00:26:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 -- 172.21.15.77:0/628896686 learned_addr learned my addr 172.21.15.77:0/628896686 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332ed9d700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f333015eda0 0x7f3330151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 -- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f333015eda0 msgr2=0x7f3330151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f333015eda0 0x7f3330151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 -- 172.21.15.77:0/628896686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333015b5e0 msgr2=0x7f3330151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333015b5e0 0x7f3330151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.807+0000 7f332e59c700 1 -- 172.21.15.77:0/628896686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009c40 con 0x7f33300c9fb0 2023-08-31T00:26:33.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.808+0000 7f332e59c700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 0x7f333006d3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f332000b450 tx=0x7f332000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:33.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.808+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200059b0 con 0x7f33300c9fb0 2023-08-31T00:26:33.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.808+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3320005b30 con 0x7f33300c9fb0 2023-08-31T00:26:33.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.808+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320011630 con 0x7f33300c9fb0 2023-08-31T00:26:33.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.808+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333006cba0 con 0x7f33300c9fb0 2023-08-31T00:26:33.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.808+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33301e7bb0 con 0x7f33300c9fb0 2023-08-31T00:26:33.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.810+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333006e330 con 0x7f33300c9fb0 2023-08-31T00:26:33.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.811+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3320011a90 con 0x7f33300c9fb0 2023-08-31T00:26:33.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.811+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f332001a750 con 0x7f33300c9fb0 2023-08-31T00:26:33.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.814+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3320015030 con 0x7f33300c9fb0 2023-08-31T00:26:33.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.820+0000 7f59fa7fc700 1 -- 172.21.15.77:0/779151199 <== mon.2 v2:172.21.15.139:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug mds balancer}]=0 v8)=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7f5a0000f460 con 0x7f5a040c9ef0 2023-08-31T00:26:33.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 msgr2=0x7f5a04145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 0x7f5a04145e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5a040afa90 tx=0x7f5a00004750 comp rx=0 tx=0).stop 2023-08-31T00:26:33.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 shutdown_connections 2023-08-31T00:26:33.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a0415f0e0 0x7f5a041521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a040c9b10 0x7f5a04151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 --2- 172.21.15.77:0/779151199 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a040c9ef0 0x7f5a04145e40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 >> 172.21.15.77:0/779151199 conn(0x7f5a0406a4d0 msgr2=0x7f5a040b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 shutdown_connections 2023-08-31T00:26:33.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.822+0000 7f5a0bd2a700 1 -- 172.21.15.77:0/779151199 wait complete. 2023-08-31T00:26:33.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.834+0000 7fb8cf849700 1 -- 172.21.15.77:0/3557723147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80c9ff0 msgr2=0x7fb8c80ad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.834+0000 7fb8cf849700 1 --2- 172.21.15.77:0/3557723147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80c9ff0 0x7fb8c80ad210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4005fd0 tx=0x7fb8c4009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:33.843 DEBUG:tasks.ceph:set 21 configs 2023-08-31T00:26:33.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.835+0000 7fb8cf849700 1 -- 172.21.15.77:0/3557723147 shutdown_connections 2023-08-31T00:26:33.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.835+0000 7fb8cf849700 1 --2- 172.21.15.77:0/3557723147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80c9ff0 0x7fb8c80ad210 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.835+0000 7fb8cf849700 1 --2- 172.21.15.77:0/3557723147 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.835+0000 7fb8cf849700 1 -- 172.21.15.77:0/3557723147 >> 172.21.15.77:0/3557723147 conn(0x7fb8c80cd370 msgr2=0x7fb8c80cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.835+0000 7fb8cf849700 1 -- 172.21.15.77:0/3557723147 shutdown_connections 2023-08-31T00:26:33.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.835+0000 7fb8cf849700 1 -- 172.21.15.77:0/3557723147 wait complete. 2023-08-31T00:26:33.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.837+0000 7fb8cf849700 1 Processor -- start 2023-08-31T00:26:33.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.837+0000 7fb8cf849700 1 -- start start 2023-08-31T00:26:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cf849700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8c80c9ff0 0x7fb8c814f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cf849700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80cce80 0x7fb8c809a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cf849700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cf849700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80c37c0 con 0x7fb8c80cce80 2023-08-31T00:26:33.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cf849700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81507a0 con 0x7fb8c80c9ff0 2023-08-31T00:26:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cf849700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c814fb90 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.838+0000 7fb8cdde6700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:53500/0 (socket says 172.21.15.77:53500) 2023-08-31T00:26:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 -- 172.21.15.77:0/1556539068 learned_addr learned my addr 172.21.15.77:0/1556539068 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:33.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cd5e5700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8c80c9ff0 0x7fb8c814f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 -- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8c80c9ff0 msgr2=0x7fb8c814f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8c80c9ff0 0x7fb8c814f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 -- 172.21.15.77:0/1556539068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80cce80 msgr2=0x7fb8c809a9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T00:26:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80cce80 0x7fb8c809a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 -- 172.21.15.77:0/1556539068 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40095f0 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.839+0000 7fb8cdde6700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ac2b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000b7b0 tx=0x7fb8c000bac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0010800 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb8c0010a50 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0010e60 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c814fe70 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c8150430 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb8c0019450 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.840+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb8c00218c0 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.842+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a80052f0 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.844+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb8c001e060 con 0x7fb8c80ce0a0 2023-08-31T00:26:33.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.888+0000 7fb247655700 1 -- 172.21.15.77:0/337534025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400cb7c0 msgr2=0x7fb24015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.888+0000 7fb247655700 1 --2- 172.21.15.77:0/337534025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb238009f60 tx=0x7fb238009f90 comp rx=0 tx=0).stop 2023-08-31T00:26:33.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.885+0000 7feb78b05700 1 -- 172.21.15.77:0/2194848647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9ef0 msgr2=0x7feb740cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.885+0000 7feb78b05700 1 --2- 172.21.15.77:0/2194848647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9ef0 0x7feb740cb7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7feb68009990 tx=0x7feb68009ca0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.887+0000 7feb78b05700 1 -- 172.21.15.77:0/2194848647 shutdown_connections 2023-08-31T00:26:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.887+0000 7feb78b05700 1 --2- 172.21.15.77:0/2194848647 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9ef0 0x7feb740cb7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.887+0000 7feb78b05700 1 -- 172.21.15.77:0/2194848647 >> 172.21.15.77:0/2194848647 conn(0x7feb7406a4d0 msgr2=0x7feb740aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.895+0000 7feb78b05700 1 -- 172.21.15.77:0/2194848647 shutdown_connections 2023-08-31T00:26:33.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.895+0000 7feb78b05700 1 -- 172.21.15.77:0/2194848647 wait complete. 2023-08-31T00:26:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 Processor -- start 2023-08-31T00:26:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 -- start start 2023-08-31T00:26:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9b10 0x7feb74159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb740c9ef0 0x7feb74158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 0x7feb7406c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74158890 con 0x7feb7415a230 2023-08-31T00:26:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74158b70 con 0x7feb740c9ef0 2023-08-31T00:26:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.897+0000 7feb78b05700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb74158e50 con 0x7feb740c9b10 2023-08-31T00:26:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 0x7feb7406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 0x7feb7406c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37582/0 (socket says 172.21.15.77:37582) 2023-08-31T00:26:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 -- 172.21.15.77:0/3333186293 learned_addr learned my addr 172.21.15.77:0/3333186293 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb71d9b700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb740c9ef0 0x7feb74158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb7259c700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9b10 0x7feb74159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 -- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9b10 msgr2=0x7feb74159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9b10 0x7feb74159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 -- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb740c9ef0 msgr2=0x7feb74158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb740c9ef0 0x7feb74158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 -- 172.21.15.77:0/3333186293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680095f0 con 0x7feb7415a230 2023-08-31T00:26:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.898+0000 7feb72d9d700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 0x7feb7406c420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00cbc0 tx=0x7feb6c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.910+0000 7fb247655700 1 -- 172.21.15.77:0/337534025 shutdown_connections 2023-08-31T00:26:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.910+0000 7fb247655700 1 --2- 172.21.15.77:0/337534025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.910+0000 7fb247655700 1 -- 172.21.15.77:0/337534025 >> 172.21.15.77:0/337534025 conn(0x7fb24006a4d0 msgr2=0x7fb2400aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.907+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c003c00 con 0x7feb7415a230 2023-08-31T00:26:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.908+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb6c003d60 con 0x7feb7415a230 2023-08-31T00:26:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.908+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00aa40 con 0x7feb7415a230 2023-08-31T00:26:33.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.909+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb74159130 con 0x7feb7415a230 2023-08-31T00:26:33.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.909+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb74158580 con 0x7feb7415a230 2023-08-31T00:26:33.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.913+0000 7fb247655700 1 -- 172.21.15.77:0/337534025 shutdown_connections 2023-08-31T00:26:33.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.913+0000 7fb247655700 1 -- 172.21.15.77:0/337534025 wait complete. 2023-08-31T00:26:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.915+0000 7fb247655700 1 Processor -- start 2023-08-31T00:26:33.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.915+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feb6c0050d0 con 0x7feb7415a230 2023-08-31T00:26:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.915+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feb6c0125e0 con 0x7feb7415a230 2023-08-31T00:26:33.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.915+0000 7fb247655700 1 -- start start 2023-08-31T00:26:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb74159650 con 0x7feb7415a230 2023-08-31T00:26:33.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb247655700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 0x7fb24014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb247655700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2400c9ef0 0x7fb24015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb247655700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb247655700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24006bb30 con 0x7fb2400c9b10 2023-08-31T00:26:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb247655700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24014f1f0 con 0x7fb2400cb7c0 2023-08-31T00:26:33.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb247655700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24006bd80 con 0x7fb2400c9ef0 2023-08-31T00:26:33.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb2453f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 0x7fb24014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb2453f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 0x7fb24014ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37586/0 (socket says 172.21.15.77:37586) 2023-08-31T00:26:33.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.916+0000 7fb2453f1700 1 -- 172.21.15.77:0/1909203621 learned_addr learned my addr 172.21.15.77:0/1909203621 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:33.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb2453f1700 1 -- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2400c9ef0 msgr2=0x7fb24015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb244bf0700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2400c9ef0 0x7fb24015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb2453f1700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2400c9ef0 0x7fb24015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb245bf2700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:33.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb2453f1700 1 -- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2400cb7c0 msgr2=0x7fb24015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:33.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb2453f1700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:33.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb2453f1700 1 -- 172.21.15.77:0/1909203621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238009c40 con 0x7fb2400c9b10 2023-08-31T00:26:33.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb244bf0700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2400c9ef0 0x7fb24015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:33.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb245bf2700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.917+0000 7fb2453f1700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 0x7fb24014ecb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c550 tx=0x7fb23000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:33.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.919+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7feb74159650 con 0x7feb7415a230 2023-08-31T00:26:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.924+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300054e0 con 0x7fb2400c9b10 2023-08-31T00:26:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.924+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb230003680 con 0x7fb2400c9b10 2023-08-31T00:26:33.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.924+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230003a90 con 0x7fb2400c9b10 2023-08-31T00:26:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.927+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24006c060 con 0x7fb2400c9b10 2023-08-31T00:26:33.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.927+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24006c620 con 0x7fb2400c9b10 2023-08-31T00:26:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.938+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb23001c440 con 0x7fb2400c9b10 2023-08-31T00:26:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.938+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb230012740 con 0x7fb2400c9b10 2023-08-31T00:26:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.944+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2200052f0 con 0x7fb2400c9b10 2023-08-31T00:26:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.954+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb230017070 con 0x7fb2400c9b10 2023-08-31T00:26:33.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.987+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=debug ms}] v 0) v1 -- 0x7f333006d0c0 con 0x7f33300c9fb0 2023-08-31T00:26:34.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:33.999+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=mds bal fragment size max}] v 0) v1 -- 0x7fb8a8005870 con 0x7fb8c80ce0a0 2023-08-31T00:26:34.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.027+0000 7f331effd700 1 -- 172.21.15.77:0/628896686 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug ms}]=0 v9)=0 v9) v1 ==== 106+0+0 (secure 0 0 0) 0x7f333006d0c0 con 0x7f33300c9fb0 2023-08-31T00:26:34.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.028+0000 7f80e75f8700 1 -- 172.21.15.77:0/1540758630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0169360 msgr2=0x7f80e00b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.028+0000 7f80e75f8700 1 --2- 172.21.15.77:0/1540758630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0169360 0x7f80e00b17f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f80d00098f0 tx=0x7f80d0009c00 comp rx=0 tx=0).stop 2023-08-31T00:26:34.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.029+0000 7f80e75f8700 1 -- 172.21.15.77:0/1540758630 shutdown_connections 2023-08-31T00:26:34.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.029+0000 7f80e75f8700 1 --2- 172.21.15.77:0/1540758630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0169360 0x7f80e00b17f0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f80d00098f0 tx=0x7f80d0009c00 comp rx=0 tx=0).stop 2023-08-31T00:26:34.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.029+0000 7f80e75f8700 1 -- 172.21.15.77:0/1540758630 >> 172.21.15.77:0/1540758630 conn(0x7f80e006a4d0 msgr2=0x7f80e00aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 msgr2=0x7f333006d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 0x7f333006d3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f332000b450 tx=0x7f332000b760 comp rx=0 tx=0).stop 2023-08-31T00:26:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 shutdown_connections 2023-08-31T00:26:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f333015eda0 0x7f3330151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33300c9fb0 0x7f333006d3a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 --2- 172.21.15.77:0/628896686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f333015b5e0 0x7f3330151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 >> 172.21.15.77:0/628896686 conn(0x7f333006a4d0 msgr2=0x7f33300b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 shutdown_connections 2023-08-31T00:26:34.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.050+0000 7f3334810700 1 -- 172.21.15.77:0/628896686 wait complete. 2023-08-31T00:26:34.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.049+0000 7f80e75f8700 1 -- 172.21.15.77:0/1540758630 shutdown_connections 2023-08-31T00:26:34.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.056+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds bal split bits}] v 0) v1 -- 0x7feb740700e0 con 0x7feb7415a230 2023-08-31T00:26:34.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.060+0000 7f80e75f8700 1 -- 172.21.15.77:0/1540758630 wait complete. 2023-08-31T00:26:34.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.062+0000 7f80e75f8700 1 Processor -- start 2023-08-31T00:26:34.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.066+0000 7f80e75f8700 1 -- start start 2023-08-31T00:26:34.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.067+0000 7f80e75f8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80e00b1d30 0x7f80e006cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.067+0000 7f80e75f8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0165d70 0x7f80e0166b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.067+0000 7f80e75f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80e0212bc0 0x7f80e00a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.067+0000 7f80e75f8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e006d0c0 con 0x7f80e00b1d30 2023-08-31T00:26:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.067+0000 7f80e75f8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e006db70 con 0x7f80e0212bc0 2023-08-31T00:26:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.067+0000 7f80e75f8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e006d2d0 con 0x7f80e0165d70 2023-08-31T00:26:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.069+0000 7f80e5b95700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80e0212bc0 0x7f80e00a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.073+0000 7f80e4b93700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0165d70 0x7f80e0166b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.073+0000 7f80e4b93700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0165d70 0x7f80e0166b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:53538/0 (socket says 172.21.15.77:53538) 2023-08-31T00:26:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.073+0000 7f80e4b93700 1 -- 172.21.15.77:0/1003848713 learned_addr learned my addr 172.21.15.77:0/1003848713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.076+0000 7f80e5b95700 1 -- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0165d70 msgr2=0x7f80e0166b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.076+0000 7f80e5b95700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0165d70 0x7f80e0166b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.076+0000 7f80e5b95700 1 -- 172.21.15.77:0/1003848713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80e00b1d30 msgr2=0x7f80e006cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.076+0000 7f80e5b95700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80e00b1d30 0x7f80e006cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.076+0000 7f80e5b95700 1 -- 172.21.15.77:0/1003848713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0009520 con 0x7f80e0212bc0 2023-08-31T00:26:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.077+0000 7fb8bdffb700 1 -- 172.21.15.77:0/1556539068 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal fragment size max}]=0 v10)=0 v10) v1 ==== 127+0+0 (secure 0 0 0) 0x7fb8c0014070 con 0x7fb8c80ce0a0 2023-08-31T00:26:34.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 msgr2=0x7fb8c80ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ac2b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000b7b0 tx=0x7fb8c000bac0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 shutdown_connections 2023-08-31T00:26:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8c80ce0a0 0x7fb8c80ac2b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8c80c9ff0 0x7fb8c814f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 --2- 172.21.15.77:0/1556539068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8c80cce80 0x7fb8c809a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 >> 172.21.15.77:0/1556539068 conn(0x7fb8c80cd370 msgr2=0x7fb8c80aa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 shutdown_connections 2023-08-31T00:26:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.079+0000 7fb8cf849700 1 -- 172.21.15.77:0/1556539068 wait complete. 2023-08-31T00:26:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.080+0000 7f80e5b95700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80e0212bc0 0x7f80e00a86e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f80d800cb10 tx=0x7f80d800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.080+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8003c00 con 0x7f80e0212bc0 2023-08-31T00:26:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.080+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f80d8003d60 con 0x7f80e0212bc0 2023-08-31T00:26:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.080+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800ab60 con 0x7f80e0212bc0 2023-08-31T00:26:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.080+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e006d5b0 con 0x7f80e0212bc0 2023-08-31T00:26:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.080+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e00a6580 con 0x7f80e0212bc0 2023-08-31T00:26:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.082+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e00a6770 con 0x7f80e0212bc0 2023-08-31T00:26:34.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.085+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f80d80050d0 con 0x7f80e0212bc0 2023-08-31T00:26:34.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.085+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f80d80127c0 con 0x7f80e0212bc0 2023-08-31T00:26:34.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.086+0000 7feb62ffd700 1 -- 172.21.15.77:0/3333186293 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal split bits}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7feb6c005560 con 0x7feb7415a230 2023-08-31T00:26:34.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.087+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f80d801b400 con 0x7f80e0212bc0 2023-08-31T00:26:34.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 msgr2=0x7feb7406c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 0x7feb7406c420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00cbc0 tx=0x7feb6c00ced0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 shutdown_connections 2023-08-31T00:26:34.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb740c9b10 0x7feb74159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb7415a230 0x7feb7406c420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 --2- 172.21.15.77:0/3333186293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb740c9ef0 0x7feb74158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.095+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 >> 172.21.15.77:0/3333186293 conn(0x7feb7406a4d0 msgr2=0x7feb7415a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.099+0000 7f80def2d700 1 -- 172.21.15.77:0/3384812979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c0005330 msgr2=0x7f80c000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.099+0000 7f80def2d700 1 --2- 172.21.15.77:0/3384812979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c0005330 0x7f80c000ba10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c6f0 tx=0x7f80c0005880 comp rx=0 tx=0).stop 2023-08-31T00:26:34.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.100+0000 7f80dd4ca700 1 -- 172.21.15.77:0/3384812979 reap_dead start 2023-08-31T00:26:34.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.102+0000 7f80def2d700 1 -- 172.21.15.77:0/3384812979 shutdown_connections 2023-08-31T00:26:34.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.102+0000 7f80def2d700 1 -- 172.21.15.77:0/3384812979 >> 172.21.15.77:0/3384812979 conn(0x7f80d806a4d0 msgr2=0x7f80d80aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.096+0000 7f0d900c4700 1 -- 172.21.15.77:0/3682599222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d74003a30 msgr2=0x7f0d74003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.096+0000 7f0d900c4700 1 --2- 172.21.15.77:0/3682599222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d74003a30 0x7f0d74003e30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800c780 tx=0x7f0d74005880 comp rx=0 tx=0).stop 2023-08-31T00:26:34.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.097+0000 7f0d8e661700 1 -- 172.21.15.77:0/3682599222 reap_dead start 2023-08-31T00:26:34.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.102+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 shutdown_connections 2023-08-31T00:26:34.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.102+0000 7feb78b05700 1 -- 172.21.15.77:0/3333186293 wait complete. 2023-08-31T00:26:34.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.102+0000 7f0d900c4700 1 -- 172.21.15.77:0/3682599222 shutdown_connections 2023-08-31T00:26:34.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.102+0000 7f0d900c4700 1 -- 172.21.15.77:0/3682599222 >> 172.21.15.77:0/3682599222 conn(0x7f0d8806a4d0 msgr2=0x7f0d880aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.110+0000 7f0d900c4700 1 -- 172.21.15.77:0/3682599222 shutdown_connections 2023-08-31T00:26:34.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.110+0000 7f0d900c4700 1 -- 172.21.15.77:0/3682599222 wait complete. 2023-08-31T00:26:34.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.112+0000 7f0d900c4700 1 Processor -- start 2023-08-31T00:26:34.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.112+0000 7f0d900c4700 1 -- start start 2023-08-31T00:26:34.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.113+0000 7f0d900c4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d74003a30 0x7f0d881f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.114+0000 7f0d900c4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d880b1260 0x7f0d880b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.114+0000 7f0d900c4700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 0x7f0d881fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.114+0000 7f0d900c4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d880b1c20 con 0x7f0d880b1260 2023-08-31T00:26:34.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.114+0000 7f0d900c4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8815b2d0 con 0x7f0d74003a30 2023-08-31T00:26:34.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.114+0000 7f0d900c4700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8815be50 con 0x7f0d881fe420 2023-08-31T00:26:34.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.115+0000 7f0d8e661700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 0x7f0d881fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.115+0000 7f0d8e661700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 0x7f0d881fe8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:53562/0 (socket says 172.21.15.77:53562) 2023-08-31T00:26:34.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.115+0000 7f0d8e661700 1 -- 172.21.15.77:0/1261055721 learned_addr learned my addr 172.21.15.77:0/1261055721 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.116+0000 7f0d8e661700 1 -- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d74003a30 msgr2=0x7f0d881f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.116+0000 7f0d8e661700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d74003a30 0x7f0d881f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.116+0000 7f0d8e661700 1 -- 172.21.15.77:0/1261055721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d880b1260 msgr2=0x7f0d880b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.116+0000 7f0d8e661700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d880b1260 0x7f0d880b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.116+0000 7f0d8e661700 1 -- 172.21.15.77:0/1261055721 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8815c2e0 con 0x7f0d881fe420 2023-08-31T00:26:34.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.117+0000 7f0d8e661700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 0x7f0d881fe8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d880cbba0 tx=0x7f0d8000d430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.117+0000 7f80def2d700 1 -- 172.21.15.77:0/3384812979 shutdown_connections 2023-08-31T00:26:34.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.118+0000 7f80def2d700 1 -- 172.21.15.77:0/3384812979 wait complete. 2023-08-31T00:26:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.117+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80019070 con 0x7f0d881fe420 2023-08-31T00:26:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.117+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d8000fed0 con 0x7f0d881fe420 2023-08-31T00:26:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.117+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80004bb0 con 0x7f0d881fe420 2023-08-31T00:26:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.118+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8815b520 con 0x7f0d881fe420 2023-08-31T00:26:34.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.118+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8815bae0 con 0x7f0d881fe420 2023-08-31T00:26:34.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.118+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d80014470 con 0x7f0d881fe420 2023-08-31T00:26:34.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.118+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0d8001e910 con 0x7f0d881fe420 2023-08-31T00:26:34.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.120+0000 7f80def2d700 1 Processor -- start 2023-08-31T00:26:34.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.121+0000 7f80def2d700 1 -- start start 2023-08-31T00:26:34.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.123+0000 7f80def2d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c0005330 0x7f80d8150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.123+0000 7f80def2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 0x7f80d81500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.123+0000 7f80def2d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80d815f530 0x7f80d806c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.123+0000 7f80def2d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8150620 con 0x7f80d815dfb0 2023-08-31T00:26:34.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.123+0000 7f80def2d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815f0a0 con 0x7f80d815f530 2023-08-31T00:26:34.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.123+0000 7f80def2d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815e490 con 0x7f80c0005330 2023-08-31T00:26:34.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.124+0000 7f80dccc9700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c0005330 0x7f80d8150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.124+0000 7f80d7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 0x7f80d81500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.124+0000 7f80d7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 0x7f80d81500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37632/0 (socket says 172.21.15.77:37632) 2023-08-31T00:26:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.124+0000 7f80d7fff700 1 -- 172.21.15.77:0/2123326021 learned_addr learned my addr 172.21.15.77:0/2123326021 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.125+0000 7f80d7fff700 1 -- 172.21.15.77:0/2123326021 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c0005330 msgr2=0x7f80d8150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.125+0000 7f80d7fff700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c0005330 0x7f80d8150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.125+0000 7f80d7fff700 1 -- 172.21.15.77:0/2123326021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80d815f530 msgr2=0x7f80d806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.125+0000 7f80d7fff700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80d815f530 0x7f80d806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.125+0000 7f80d7fff700 1 -- 172.21.15.77:0/2123326021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d815e770 con 0x7f80d815dfb0 2023-08-31T00:26:34.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.127+0000 7f80d7fff700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 0x7f80d81500e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c920 tx=0x7f80cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.127+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8815c130 con 0x7f0d881fe420 2023-08-31T00:26:34.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.128+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc007850 con 0x7f80d815dfb0 2023-08-31T00:26:34.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.128+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f80cc007aa0 con 0x7f80d815dfb0 2023-08-31T00:26:34.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.128+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc007e90 con 0x7f80d815dfb0 2023-08-31T00:26:34.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.128+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d815ea50 con 0x7f80d815dfb0 2023-08-31T00:26:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.128+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d8150dc0 con 0x7f80d815dfb0 2023-08-31T00:26:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f80cc00f450 con 0x7f80d815dfb0 2023-08-31T00:26:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f80cc018810 con 0x7f80d815dfb0 2023-08-31T00:26:34.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.131+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0d8001ebd0 con 0x7f0d881fe420 2023-08-31T00:26:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.131+0000 7f0c801b5700 1 -- 172.21.15.77:0/2373708313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 msgr2=0x7f0c780cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.131+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2373708313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c780cb7c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009fd0 tx=0x7f0c7000b3d0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f0c801b5700 1 -- 172.21.15.77:0/2373708313 shutdown_connections 2023-08-31T00:26:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2373708313 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c780cb7c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2373708313 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780c9ef0 0x7f0c780715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f0c801b5700 1 -- 172.21.15.77:0/2373708313 >> 172.21.15.77:0/2373708313 conn(0x7f0c7806a4d0 msgr2=0x7f0c780aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.132+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b80052f0 con 0x7f80d815dfb0 2023-08-31T00:26:34.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.137+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f80cc00f840 con 0x7f80d815dfb0 2023-08-31T00:26:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.137+0000 7f0c801b5700 1 -- 172.21.15.77:0/2373708313 shutdown_connections 2023-08-31T00:26:34.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.137+0000 7f0c801b5700 1 -- 172.21.15.77:0/2373708313 wait complete. 2023-08-31T00:26:34.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.139+0000 7f0c801b5700 1 Processor -- start 2023-08-31T00:26:34.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.139+0000 7f0c801b5700 1 -- start start 2023-08-31T00:26:34.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.140+0000 7f0c801b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c7814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.140+0000 7f0c801b5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780c9ef0 0x7f0c7814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.140+0000 7f0c801b5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c7815f0e0 0x7f0c780ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.140+0000 7f0c801b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7814c8a0 con 0x7f0c780c9b10 2023-08-31T00:26:34.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.140+0000 7f0c801b5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7814d630 con 0x7f0c7815f0e0 2023-08-31T00:26:34.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.140+0000 7f0c801b5700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7814d910 con 0x7f0c780c9ef0 2023-08-31T00:26:34.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.141+0000 7f0c7e752700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c7815f0e0 0x7f0c780ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.141+0000 7f0c7e752700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c7815f0e0 0x7f0c780ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:49192/0 (socket says 172.21.15.77:49192) 2023-08-31T00:26:34.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.141+0000 7f0c7e752700 1 -- 172.21.15.77:0/2951883377 learned_addr learned my addr 172.21.15.77:0/2951883377 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7d750700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780c9ef0 0x7f0c7814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7df51700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c7814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7df51700 1 -- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780c9ef0 msgr2=0x7f0c7814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7df51700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780c9ef0 0x7f0c7814fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7df51700 1 -- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c7815f0e0 msgr2=0x7f0c780ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7df51700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c7815f0e0 0x7f0c780ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.147+0000 7f0c7df51700 1 -- 172.21.15.77:0/2951883377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70009d00 con 0x7f0c780c9b10 2023-08-31T00:26:34.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.148+0000 7f0c7df51700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c7814cfa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c70014000 tx=0x7f0c700096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.148+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds bal merge size}] v 0) v1 -- 0x7fb220005910 con 0x7fb2400c9b10 2023-08-31T00:26:34.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.148+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000e070 con 0x7f0c780c9b10 2023-08-31T00:26:34.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.148+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c700094d0 con 0x7f0c780c9b10 2023-08-31T00:26:34.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.148+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007da0 con 0x7f0c780c9b10 2023-08-31T00:26:34.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.149+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7814dbf0 con 0x7f0c780c9b10 2023-08-31T00:26:34.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.149+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7814e6d0 con 0x7f0c780c9b10 2023-08-31T00:26:34.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.151+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7814e3f0 con 0x7f0c780c9b10 2023-08-31T00:26:34.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.162+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c70019040 con 0x7f0c780c9b10 2023-08-31T00:26:34.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.163+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0c70024450 con 0x7f0c780c9b10 2023-08-31T00:26:34.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.163+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0c7814e3f0 con 0x7f0c780c9b10 2023-08-31T00:26:34.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.171+0000 7f692506d700 1 -- 172.21.15.77:0/146332272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 msgr2=0x7f692015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.171+0000 7f692506d700 1 --2- 172.21.15.77:0/146332272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 0x7f692015a680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69200af6c0 tx=0x7f691800b380 comp rx=0 tx=0).stop 2023-08-31T00:26:34.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.172+0000 7f692506d700 1 -- 172.21.15.77:0/146332272 shutdown_connections 2023-08-31T00:26:34.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.172+0000 7f692506d700 1 --2- 172.21.15.77:0/146332272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 0x7f692015a680 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.172+0000 7f692506d700 1 --2- 172.21.15.77:0/146332272 >> v2:172.21.15.139:3300/0 conn(0x7f69200c9b10 0x7f69200cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.172+0000 7f692506d700 1 -- 172.21.15.77:0/146332272 >> 172.21.15.77:0/146332272 conn(0x7f692006a4d0 msgr2=0x7f69200aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.172+0000 7f692506d700 1 -- 172.21.15.77:0/146332272 shutdown_connections 2023-08-31T00:26:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.173+0000 7f132f920700 1 -- 172.21.15.77:0/2702947525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132815a230 msgr2=0x7f132815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.173+0000 7f132f920700 1 --2- 172.21.15.77:0/2702947525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132815a230 0x7f132815a6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1320009f60 tx=0x7f1320009f90 comp rx=0 tx=0).stop 2023-08-31T00:26:34.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.172+0000 7f692506d700 1 -- 172.21.15.77:0/146332272 wait complete. 2023-08-31T00:26:34.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.174+0000 7f692506d700 1 Processor -- start 2023-08-31T00:26:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.175+0000 7f692506d700 1 -- start start 2023-08-31T00:26:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f692506d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 0x7f69200a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f692506d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69200c9ef0 0x7f692006d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f692506d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 0x7f69200a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f692506d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200a8ad0 con 0x7f692015a230 2023-08-31T00:26:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f692506d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200a8d00 con 0x7f69200c9b10 2023-08-31T00:26:34.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f692506d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200a8fe0 con 0x7f69200c9ef0 2023-08-31T00:26:34.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f691ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 0x7f69200a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f691ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 0x7f69200a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:49210/0 (socket says 172.21.15.77:49210) 2023-08-31T00:26:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.176+0000 7f691ed9d700 1 -- 172.21.15.77:0/4195359992 learned_addr learned my addr 172.21.15.77:0/4195359992 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691f59e700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 0x7f69200a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691ed9d700 1 -- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69200c9ef0 msgr2=0x7f692006d690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T00:26:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691ed9d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69200c9ef0 0x7f692006d690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691ed9d700 1 -- 172.21.15.77:0/4195359992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 msgr2=0x7f69200a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691ed9d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 0x7f69200a6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691ed9d700 1 -- 172.21.15.77:0/4195359992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918009d00 con 0x7f69200c9b10 2023-08-31T00:26:34.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.177+0000 7f691ed9d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 0x7f69200a9da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f691000c970 tx=0x7f691000cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.179+0000 7f132f920700 1 -- 172.21.15.77:0/2702947525 shutdown_connections 2023-08-31T00:26:34.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.179+0000 7f132f920700 1 --2- 172.21.15.77:0/2702947525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f132815a230 0x7f132815a6a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.179+0000 7f132f920700 1 --2- 172.21.15.77:0/2702947525 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f13280c9b10 0x7f13280cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.179+0000 7f132f920700 1 -- 172.21.15.77:0/2702947525 >> 172.21.15.77:0/2702947525 conn(0x7f132806a4d0 msgr2=0x7f13280aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.180+0000 7f132f920700 1 -- 172.21.15.77:0/2702947525 shutdown_connections 2023-08-31T00:26:34.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.180+0000 7f132f920700 1 -- 172.21.15.77:0/2702947525 wait complete. 2023-08-31T00:26:34.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.182+0000 7f132f920700 1 Processor -- start 2023-08-31T00:26:34.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.182+0000 7f132f920700 1 -- start start 2023-08-31T00:26:34.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.178+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910007aa0 con 0x7f69200c9b10 2023-08-31T00:26:34.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.178+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6910007cf0 con 0x7f69200c9b10 2023-08-31T00:26:34.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.178+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910004a90 con 0x7f69200c9b10 2023-08-31T00:26:34.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132f920700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13280c9b10 0x7f1328151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132f920700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13280c9ef0 0x7f1328155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132f920700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f132815a230 0x7f1328156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132f920700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13281515c0 con 0x7f13280c9ef0 2023-08-31T00:26:34.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132f920700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132806d0e0 con 0x7f13280c9b10 2023-08-31T00:26:34.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132f920700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13281505a0 con 0x7f132815a230 2023-08-31T00:26:34.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69200701b0 con 0x7f69200c9b10 2023-08-31T00:26:34.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69200a95a0 con 0x7f69200c9b10 2023-08-31T00:26:34.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132d6bc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13280c9b10 0x7f1328151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.183+0000 7f132debd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f132815a230 0x7f1328156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.184+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6910004bf0 con 0x7f69200c9b10 2023-08-31T00:26:34.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.184+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f691000f790 con 0x7f69200c9b10 2023-08-31T00:26:34.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.184+0000 7f132d6bc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13280c9b10 0x7f1328151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:49214/0 (socket says 172.21.15.77:49214) 2023-08-31T00:26:34.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.184+0000 7f132d6bc700 1 -- 172.21.15.77:0/1987320277 learned_addr learned my addr 172.21.15.77:0/1987320277 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.185+0000 7f132debd700 1 -- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13280c9b10 msgr2=0x7f1328151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.185+0000 7f132debd700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13280c9b10 0x7f1328151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.185+0000 7f132debd700 1 -- 172.21.15.77:0/1987320277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13280c9ef0 msgr2=0x7f1328155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.185+0000 7f132debd700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13280c9ef0 0x7f1328155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.185+0000 7f132debd700 1 -- 172.21.15.77:0/1987320277 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009c40 con 0x7f132815a230 2023-08-31T00:26:34.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.187+0000 7f132debd700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f132815a230 0x7f1328156530 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1320015000 tx=0x7f1320007b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.186+0000 7fb235ffb700 1 -- 172.21.15.77:0/1909203621 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal merge size}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb230012a90 con 0x7fb2400c9b10 2023-08-31T00:26:34.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.187+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 msgr2=0x7fb24014ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.187+0000 7fb247655700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 0x7fb24014ecb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c550 tx=0x7fb23000c910 comp rx=0 tx=0).stop 2023-08-31T00:26:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 shutdown_connections 2023-08-31T00:26:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2400cb7c0 0x7fb24015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2400c9b10 0x7fb24014ecb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 --2- 172.21.15.77:0/1909203621 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb2400c9ef0 0x7fb24015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 >> 172.21.15.77:0/1909203621 conn(0x7fb24006a4d0 msgr2=0x7fb2400acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 shutdown_connections 2023-08-31T00:26:34.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132000e040 con 0x7f132815a230 2023-08-31T00:26:34.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f132001d680 con 0x7f132815a230 2023-08-31T00:26:34.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132001da90 con 0x7f132815a230 2023-08-31T00:26:34.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1328150880 con 0x7f132815a230 2023-08-31T00:26:34.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328152460 con 0x7f132815a230 2023-08-31T00:26:34.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.188+0000 7fb247655700 1 -- 172.21.15.77:0/1909203621 wait complete. 2023-08-31T00:26:34.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.190+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f132001b450 con 0x7f132815a230 2023-08-31T00:26:34.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.190+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1320026410 con 0x7f132815a230 2023-08-31T00:26:34.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.190+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1328150da0 con 0x7f132815a230 2023-08-31T00:26:34.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.202+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1328150da0 con 0x7f132815a230 2023-08-31T00:26:34.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.206+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920073c30 con 0x7f69200c9b10 2023-08-31T00:26:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.210+0000 7fb83abf9700 1 -- 172.21.15.77:0/1229400138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8340c9ef0 msgr2=0x7fb8340cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.210+0000 7fb83abf9700 1 --2- 172.21.15.77:0/1229400138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8340c9ef0 0x7fb8340cb7c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb8340c92a0 tx=0x7fb824009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:34.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.209+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f691001d060 con 0x7f69200c9b10 2023-08-31T00:26:34.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.215+0000 7fb83abf9700 1 -- 172.21.15.77:0/1229400138 shutdown_connections 2023-08-31T00:26:34.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.215+0000 7fb83abf9700 1 --2- 172.21.15.77:0/1229400138 >> v2:172.21.15.139:3300/0 conn(0x7fb83415a230 0x7fb83415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.215+0000 7fb83abf9700 1 --2- 172.21.15.77:0/1229400138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8340c9ef0 0x7fb8340cb7c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.215+0000 7fb83abf9700 1 -- 172.21.15.77:0/1229400138 >> 172.21.15.77:0/1229400138 conn(0x7fb83406a4d0 msgr2=0x7fb8340aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.216+0000 7f1802613700 1 -- 172.21.15.77:0/2198264780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0b17f0 msgr2=0x7f17fc0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.216+0000 7f1802613700 1 --2- 172.21.15.77:0/2198264780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0b17f0 0x7f17fc0b1ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17fc06f870 tx=0x7f17f400b380 comp rx=0 tx=0).stop 2023-08-31T00:26:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.216+0000 7f1802613700 1 -- 172.21.15.77:0/2198264780 shutdown_connections 2023-08-31T00:26:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.216+0000 7f1802613700 1 --2- 172.21.15.77:0/2198264780 >> v2:172.21.15.77:3300/0 conn(0x7f17fc169360 0x7f17fc16c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.216+0000 7f1802613700 1 --2- 172.21.15.77:0/2198264780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0b17f0 0x7f17fc0b1ca0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.216+0000 7f1802613700 1 -- 172.21.15.77:0/2198264780 >> 172.21.15.77:0/2198264780 conn(0x7f17fc06a4d0 msgr2=0x7f17fc0aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7fb83abf9700 1 -- 172.21.15.77:0/1229400138 shutdown_connections 2023-08-31T00:26:34.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7f52e4c85700 1 -- 172.21.15.77:0/165892107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 msgr2=0x7f52e00715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7f52e4c85700 1 --2- 172.21.15.77:0/165892107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 0x7f52e00715c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f52e00aea90 tx=0x7f52d0009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:34.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7f52e4c85700 1 -- 172.21.15.77:0/165892107 shutdown_connections 2023-08-31T00:26:34.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7f52e4c85700 1 --2- 172.21.15.77:0/165892107 >> v2:172.21.15.77:3300/0 conn(0x7f52e00c9b10 0x7f52e00cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7f52e4c85700 1 --2- 172.21.15.77:0/165892107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 0x7f52e00715c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7f52e4c85700 1 -- 172.21.15.77:0/165892107 >> 172.21.15.77:0/165892107 conn(0x7f52e006a4d0 msgr2=0x7f52e00aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.217+0000 7fb83abf9700 1 -- 172.21.15.77:0/1229400138 wait complete. 2023-08-31T00:26:34.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.218+0000 7fb83abf9700 1 Processor -- start 2023-08-31T00:26:34.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.219+0000 7fb83abf9700 1 -- start start 2023-08-31T00:26:34.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7f1802613700 1 -- 172.21.15.77:0/2198264780 shutdown_connections 2023-08-31T00:26:34.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb83abf9700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8340c9b10 0x7fb83415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb83abf9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8340c9ef0 0x7fb83415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb83abf9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 0x7fb83414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb83abf9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83415e960 con 0x7fb83415a230 2023-08-31T00:26:34.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb83abf9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83415dce0 con 0x7fb8340c9ef0 2023-08-31T00:26:34.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb83abf9700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83415dfc0 con 0x7fb8340c9b10 2023-08-31T00:26:34.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb839196700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 0x7fb83414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb839196700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 0x7fb83414ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37688/0 (socket says 172.21.15.77:37688) 2023-08-31T00:26:34.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb839196700 1 -- 172.21.15.77:0/2390777113 learned_addr learned my addr 172.21.15.77:0/2390777113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7fb833fff700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8340c9ef0 0x7fb83415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7f52e4c85700 1 -- 172.21.15.77:0/165892107 shutdown_connections 2023-08-31T00:26:34.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7f52e4c85700 1 -- 172.21.15.77:0/165892107 wait complete. 2023-08-31T00:26:34.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.223+0000 7f52e4c85700 1 Processor -- start 2023-08-31T00:26:34.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.220+0000 7f1802613700 1 -- 172.21.15.77:0/2198264780 wait complete. 2023-08-31T00:26:34.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.222+0000 7f1802613700 1 Processor -- start 2023-08-31T00:26:34.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.223+0000 7f1802613700 1 -- start start 2023-08-31T00:26:34.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb839196700 1 -- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8340c9b10 msgr2=0x7fb83415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb839196700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8340c9b10 0x7fb83415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb839196700 1 -- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8340c9ef0 msgr2=0x7fb83415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb839196700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8340c9ef0 0x7fb83415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb839196700 1 -- 172.21.15.77:0/2390777113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240095f0 con 0x7fb83415a230 2023-08-31T00:26:34.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb839196700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 0x7fb83414ed10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb82c007fc0 tx=0x7fb82c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c004bb0 con 0x7fb83415a230 2023-08-31T00:26:34.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb82c004e40 con 0x7fb83415a230 2023-08-31T00:26:34.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.221+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c005280 con 0x7fb83415a230 2023-08-31T00:26:34.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.222+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83415e2a0 con 0x7fb83415a230 2023-08-31T00:26:34.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.222+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83415d920 con 0x7fb83415a230 2023-08-31T00:26:34.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1802613700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0afe00 0x7f17fc149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1802613700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 0x7f17fc166300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1802613700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f17fc169360 0x7f17fc1676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1802613700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc149c60 con 0x7f17fc0b17f0 2023-08-31T00:26:34.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1802613700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc166840 con 0x7f17fc0afe00 2023-08-31T00:26:34.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1802613700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc177190 con 0x7f17fc169360 2023-08-31T00:26:34.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f17fb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 0x7f17fc166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f17fb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 0x7f17fc166300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37694/0 (socket says 172.21.15.77:37694) 2023-08-31T00:26:34.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f17fb7fe700 1 -- 172.21.15.77:0/204178176 learned_addr learned my addr 172.21.15.77:0/204178176 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f1800bb0700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f17fc169360 0x7f17fc1676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17fb7fe700 1 -- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f17fc169360 msgr2=0x7f17fc1676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17fb7fe700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f17fc169360 0x7f17fc1676e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17fb7fe700 1 -- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0afe00 msgr2=0x7f17fc149720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:26:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17fb7fe700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0afe00 0x7f17fc149720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17fb7fe700 1 -- 172.21.15.77:0/204178176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009d00 con 0x7f17fc0b17f0 2023-08-31T00:26:34.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17fb7fe700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 0x7f17fc166300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17f4000f80 tx=0x7f17f400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e040 con 0x7f17fc0b17f0 2023-08-31T00:26:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17f4007ae0 con 0x7f17fc0b17f0 2023-08-31T00:26:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4004030 con 0x7f17fc0b17f0 2023-08-31T00:26:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc166ae0 con 0x7f17fc0b17f0 2023-08-31T00:26:34.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc1670a0 con 0x7f17fc0b17f0 2023-08-31T00:26:34.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb82c0056e0 con 0x7fb83415a230 2023-08-31T00:26:34.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb82c014c70 con 0x7fb83415a230 2023-08-31T00:26:34.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.224+0000 7f52e4c85700 1 -- start start 2023-08-31T00:26:34.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f52e4c85700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 0x7f52e014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f52e4c85700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 0x7f52e015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f52e4c85700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f52e015f0e0 0x7f52e015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f52e4c85700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e015b2d0 con 0x7f52e00c9b10 2023-08-31T00:26:34.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f52e4c85700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e015d7d0 con 0x7f52e00c9ef0 2023-08-31T00:26:34.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.225+0000 7f52e4c85700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e015dab0 con 0x7f52e015f0e0 2023-08-31T00:26:34.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7f52de59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 0x7f52e014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7f52de59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 0x7f52e014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37698/0 (socket says 172.21.15.77:37698) 2023-08-31T00:26:34.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7f52de59c700 1 -- 172.21.15.77:0/437533914 learned_addr learned my addr 172.21.15.77:0/437533914 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7f52ddd9b700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 0x7f52e015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.226+0000 7f52ded9d700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f52e015f0e0 0x7f52e015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f52de59c700 1 -- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f52e015f0e0 msgr2=0x7f52e015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f52de59c700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f52e015f0e0 0x7f52e015bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f52de59c700 1 -- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 msgr2=0x7f52e015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f52de59c700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 0x7f52e015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f52de59c700 1 -- 172.21.15.77:0/437533914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00095f0 con 0x7f52e00c9b10 2023-08-31T00:26:34.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f52de59c700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 0x7f52e014f840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f52d400d950 tx=0x7f52d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f17f4004490 con 0x7f17fc0b17f0 2023-08-31T00:26:34.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.227+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f17f401d970 con 0x7f17fc0b17f0 2023-08-31T00:26:34.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.228+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc1672c0 con 0x7f17fc0b17f0 2023-08-31T00:26:34.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.228+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb834073c30 con 0x7fb83415a230 2023-08-31T00:26:34.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.235+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f17f4017070 con 0x7f17fc0b17f0 2023-08-31T00:26:34.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.236+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb82c022060 con 0x7fb83415a230 2023-08-31T00:26:34.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.246+0000 7fefe8a47700 1 -- 172.21.15.77:0/1336828930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415ada0 msgr2=0x7fefe406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.246+0000 7fefe8a47700 1 --2- 172.21.15.77:0/1336828930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415ada0 0x7fefe406cd00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefe40c7c40 tx=0x7fefd8009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:34.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4009930 con 0x7f52e00c9b10 2023-08-31T00:26:34.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52d4009b80 con 0x7f52e00c9b10 2023-08-31T00:26:34.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4010460 con 0x7f52e00c9b10 2023-08-31T00:26:34.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e015b520 con 0x7f52e00c9b10 2023-08-31T00:26:34.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e01503b0 con 0x7f52e00c9b10 2023-08-31T00:26:34.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f52d4004320 con 0x7f52e00c9b10 2023-08-31T00:26:34.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.250+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f52d4010940 con 0x7f52e00c9b10 2023-08-31T00:26:34.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.251+0000 7fefe8a47700 1 -- 172.21.15.77:0/1336828930 shutdown_connections 2023-08-31T00:26:34.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.251+0000 7fefe8a47700 1 --2- 172.21.15.77:0/1336828930 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fefe415b180 0x7fefe40cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.251+0000 7fefe8a47700 1 --2- 172.21.15.77:0/1336828930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415ada0 0x7fefe406cd00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.251+0000 7fefe8a47700 1 --2- 172.21.15.77:0/1336828930 >> v2:172.21.15.139:3300/0 conn(0x7fefe406c8c0 0x7fefe40c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.251+0000 7fefe8a47700 1 -- 172.21.15.77:0/1336828930 >> 172.21.15.77:0/1336828930 conn(0x7fefe40cccb0 msgr2=0x7fefe40cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.263+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e015ba40 con 0x7f52e00c9b10 2023-08-31T00:26:34.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.274+0000 7fefe8a47700 1 -- 172.21.15.77:0/1336828930 shutdown_connections 2023-08-31T00:26:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.274+0000 7fefe8a47700 1 -- 172.21.15.77:0/1336828930 wait complete. 2023-08-31T00:26:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.276+0000 7fefe8a47700 1 Processor -- start 2023-08-31T00:26:34.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.274+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f52e015ba40 con 0x7f52e00c9b10 2023-08-31T00:26:34.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.276+0000 7fefe8a47700 1 -- start start 2023-08-31T00:26:34.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.277+0000 7fefe8a47700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe406c8c0 0x7fefe41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.277+0000 7fefe8a47700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fefe415ada0 0x7fefe41fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.277+0000 7fefe8a47700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 0x7fefe42010f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.277+0000 7fefe8a47700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c5730 con 0x7fefe415b180 2023-08-31T00:26:34.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.277+0000 7fefe8a47700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe41fe830 con 0x7fefe406c8c0 2023-08-31T00:26:34.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.277+0000 7fefe8a47700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4201630 con 0x7fefe415ada0 2023-08-31T00:26:34.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 0x7fefe42010f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 0x7fefe42010f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37714/0 (socket says 172.21.15.77:37714) 2023-08-31T00:26:34.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 -- 172.21.15.77:0/2229542627 learned_addr learned my addr 172.21.15.77:0/2229542627 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 -- 172.21.15.77:0/2229542627 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fefe415ada0 msgr2=0x7fefe41fe2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fefe415ada0 0x7fefe41fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 -- 172.21.15.77:0/2229542627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe406c8c0 msgr2=0x7fefe41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe406c8c0 0x7fefe41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.278+0000 7fefe3fff700 1 -- 172.21.15.77:0/2229542627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80095f0 con 0x7fefe415b180 2023-08-31T00:26:34.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.279+0000 7fefe3fff700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 0x7fefe42010f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fefd400d720 tx=0x7fefd400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=mds bal split size}] v 0) v1 -- 0x7f0d88073c30 con 0x7f0d881fe420 2023-08-31T00:26:34.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4004a30 con 0x7fefe415b180 2023-08-31T00:26:34.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefd4004c80 con 0x7fefe415b180 2023-08-31T00:26:34.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4005020 con 0x7fefe415b180 2023-08-31T00:26:34.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds debug scatterstat}] v 0) v1 -- 0x7f0c78073c30 con 0x7f0c780c9b10 2023-08-31T00:26:34.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40c4b20 con 0x7fefe415b180 2023-08-31T00:26:34.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.290+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe40c50e0 con 0x7fefe415b180 2023-08-31T00:26:34.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.292+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40a6830 con 0x7fefe415b180 2023-08-31T00:26:34.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.298+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds debug frag}] v 0) v1 -- 0x7f80e0073c30 con 0x7f80e0212bc0 2023-08-31T00:26:34.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.298+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=rados mon op timeout}] v 0) v1 -- 0x7f80b8005160 con 0x7f80d815dfb0 2023-08-31T00:26:34.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.299+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fefd4005480 con 0x7fefe415b180 2023-08-31T00:26:34.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.299+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fefd4025480 con 0x7fefe415b180 2023-08-31T00:26:34.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.303+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fefd4020060 con 0x7fefe415b180 2023-08-31T00:26:34.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.307+0000 7f0c6e7fc700 1 -- 172.21.15.77:0/2951883377 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds debug scatterstat}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c700330c0 con 0x7f0c780c9b10 2023-08-31T00:26:34.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.318+0000 7f80d5ffb700 1 -- 172.21.15.77:0/1003848713 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds debug frag}]=0 v14)=0 v14) v1 ==== 115+0+0 (secure 0 0 0) 0x7f80d8012b40 con 0x7f80e0212bc0 2023-08-31T00:26:34.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 msgr2=0x7f0c7814cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c7814cfa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c70014000 tx=0x7f0c700096c0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 shutdown_connections 2023-08-31T00:26:34.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c7815f0e0 0x7f0c780ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c780c9b10 0x7f0c7814cfa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 --2- 172.21.15.77:0/2951883377 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780c9ef0 0x7f0c7814fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 >> 172.21.15.77:0/2951883377 conn(0x7f0c7806a4d0 msgr2=0x7f0c780aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 shutdown_connections 2023-08-31T00:26:34.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.319+0000 7f0c801b5700 1 -- 172.21.15.77:0/2951883377 wait complete. 2023-08-31T00:26:34.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.322+0000 7f0d7e7fc700 1 -- 172.21.15.77:0/1261055721 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal split size}]=0 v15)=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0d80014900 con 0x7f0d881fe420 2023-08-31T00:26:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.323+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 msgr2=0x7f0d881fe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.323+0000 7f0d900c4700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 0x7f0d881fe8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d880cbba0 tx=0x7f0d8000d430 comp rx=0 tx=0).stop 2023-08-31T00:26:34.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.327+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=mds op complaint time}] v 0) v1 -- 0x7f13080051e0 con 0x7f132815a230 2023-08-31T00:26:34.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.330+0000 7f80d57fa700 1 -- 172.21.15.77:0/2123326021 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados mon op timeout}]=0 v16)=0 v16) v1 ==== 120+0+0 (secure 0 0 0) 0x7f80cc018ad0 con 0x7f80d815dfb0 2023-08-31T00:26:34.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 shutdown_connections 2023-08-31T00:26:34.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f0d900c4700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0d881fe420 0x7f0d881fe8a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f0d900c4700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d74003a30 0x7f0d881f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f0d900c4700 1 --2- 172.21.15.77:0/1261055721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d880b1260 0x7f0d880b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 >> 172.21.15.77:0/1261055721 conn(0x7f0d8806a4d0 msgr2=0x7f0d8806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80e0212bc0 msgr2=0x7f80e00a86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f80e75f8700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80e0212bc0 0x7f80e00a86e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f80d800cb10 tx=0x7f80d800ced0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 msgr2=0x7f80d81500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.332+0000 7f80def2d700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 0x7f80d81500e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c920 tx=0x7f80cc00cc30 comp rx=0 tx=0).stop 2023-08-31T00:26:34.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 shutdown_connections 2023-08-31T00:26:34.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f0d900c4700 1 -- 172.21.15.77:0/1261055721 wait complete. 2023-08-31T00:26:34.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 shutdown_connections 2023-08-31T00:26:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f80def2d700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80c0005330 0x7f80d8150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f80def2d700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80d815f530 0x7f80d806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f80def2d700 1 --2- 172.21.15.77:0/2123326021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80d815dfb0 0x7f80d81500e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.333+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 >> 172.21.15.77:0/2123326021 conn(0x7f80d806a4d0 msgr2=0x7f80d80ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.335+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 shutdown_connections 2023-08-31T00:26:34.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.342+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 shutdown_connections 2023-08-31T00:26:34.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.342+0000 7f80e75f8700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80e0212bc0 0x7f80e00a86e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.342+0000 7f80e75f8700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80e00b1d30 0x7f80e006cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.342+0000 7f80e75f8700 1 --2- 172.21.15.77:0/1003848713 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f80e0165d70 0x7f80e0166b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.342+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 >> 172.21.15.77:0/1003848713 conn(0x7f80e006a4d0 msgr2=0x7f80e00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.344+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=osd op complaint time}] v 0) v1 -- 0x7fb8340cc380 con 0x7fb83415a230 2023-08-31T00:26:34.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.344+0000 7f80def2d700 1 -- 172.21.15.77:0/2123326021 wait complete. 2023-08-31T00:26:34.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.344+0000 7f131dffb700 1 -- 172.21.15.77:0/1987320277 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds op complaint time}]=0 v17)=0 v17) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1320021020 con 0x7f132815a230 2023-08-31T00:26:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.348+0000 7fb8317fa700 1 -- 172.21.15.77:0/2390777113 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd op complaint time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb82c005a80 con 0x7fb83415a230 2023-08-31T00:26:34.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 msgr2=0x7fb83414ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 0x7fb83414ed10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb82c007fc0 tx=0x7fb82c00a650 comp rx=0 tx=0).stop 2023-08-31T00:26:34.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 shutdown_connections 2023-08-31T00:26:34.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb8340c9b10 0x7fb83415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb83415a230 0x7fb83414ed10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 --2- 172.21.15.77:0/2390777113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8340c9ef0 0x7fb83415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 >> 172.21.15.77:0/2390777113 conn(0x7fb83406a4d0 msgr2=0x7fb83406db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.350+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 shutdown_connections 2023-08-31T00:26:34.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.351+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 shutdown_connections 2023-08-31T00:26:34.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f132815a230 msgr2=0x7f1328156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f132815a230 0x7f1328156530 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1320015000 tx=0x7f1320007b50 comp rx=0 tx=0).stop 2023-08-31T00:26:34.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 shutdown_connections 2023-08-31T00:26:34.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f132815a230 0x7f1328156530 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13280c9b10 0x7f1328151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 --2- 172.21.15.77:0/1987320277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13280c9ef0 0x7f1328155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.352+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 >> 172.21.15.77:0/1987320277 conn(0x7f132806a4d0 msgr2=0x7f13280cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.356+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 shutdown_connections 2023-08-31T00:26:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.357+0000 7fb83abf9700 1 -- 172.21.15.77:0/2390777113 wait complete. 2023-08-31T00:26:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.357+0000 7f80e75f8700 1 -- 172.21.15.77:0/1003848713 wait complete. 2023-08-31T00:26:34.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.358+0000 7f132f920700 1 -- 172.21.15.77:0/1987320277 wait complete. 2023-08-31T00:26:34.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.361+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon op complaint time}] v 0) v1 -- 0x7f6920070000 con 0x7f69200c9b10 2023-08-31T00:26:34.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.370+0000 7f69077fe700 1 -- 172.21.15.77:0/4195359992 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon op complaint time}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6910005030 con 0x7f69200c9b10 2023-08-31T00:26:34.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 msgr2=0x7f69200a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 0x7f69200a9da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f691000c970 tx=0x7f691000cd30 comp rx=0 tx=0).stop 2023-08-31T00:26:34.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 shutdown_connections 2023-08-31T00:26:34.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f692015a230 0x7f69200a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69200c9b10 0x7f69200a9da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 --2- 172.21.15.77:0/4195359992 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69200c9ef0 0x7f692006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 >> 172.21.15.77:0/4195359992 conn(0x7f692006a4d0 msgr2=0x7f69200ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 shutdown_connections 2023-08-31T00:26:34.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.374+0000 7f692506d700 1 -- 172.21.15.77:0/4195359992 wait complete. 2023-08-31T00:26:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.383+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=osd op complaint time}] v 0) v1 -- 0x7f17fc073c30 con 0x7f17fc0b17f0 2023-08-31T00:26:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.388+0000 7f17f8ff9700 1 -- 172.21.15.77:0/204178176 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd op complaint time}]=0 v20)=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f17f4004920 con 0x7f17fc0b17f0 2023-08-31T00:26:34.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 msgr2=0x7f17fc166300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 0x7f17fc166300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17f4000f80 tx=0x7f17f400be70 comp rx=0 tx=0).stop 2023-08-31T00:26:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 shutdown_connections 2023-08-31T00:26:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f17fc169360 0x7f17fc1676e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17fc0afe00 0x7f17fc149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 --2- 172.21.15.77:0/204178176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17fc0b17f0 0x7f17fc166300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.389+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 >> 172.21.15.77:0/204178176 conn(0x7f17fc06a4d0 msgr2=0x7f17fc16b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.390+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 shutdown_connections 2023-08-31T00:26:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.390+0000 7f1802613700 1 -- 172.21.15.77:0/204178176 wait complete. 2023-08-31T00:26:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.410+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mds verify scatter}] v 0) v1 -- 0x7f52e0073c30 con 0x7f52e00c9b10 2023-08-31T00:26:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.414+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=rados osd op timeout}] v 0) v1 -- 0x7fefe404e7c0 con 0x7fefe415b180 2023-08-31T00:26:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.415+0000 7f52ceffd700 1 -- 172.21.15.77:0/437533914 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds verify scatter}]=0 v21)=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7f52d4020060 con 0x7f52e00c9b10 2023-08-31T00:26:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 msgr2=0x7f52e014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 0x7f52e014f840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f52d400d950 tx=0x7f52d400dc60 comp rx=0 tx=0).stop 2023-08-31T00:26:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 shutdown_connections 2023-08-31T00:26:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f52e015f0e0 0x7f52e015bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e00c9b10 0x7f52e014f840 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 --2- 172.21.15.77:0/437533914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52e00c9ef0 0x7f52e015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.416+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 >> 172.21.15.77:0/437533914 conn(0x7f52e006a4d0 msgr2=0x7f52e00aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.417+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 shutdown_connections 2023-08-31T00:26:34.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.417+0000 7f52e4c85700 1 -- 172.21.15.77:0/437533914 wait complete. 2023-08-31T00:26:34.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.417+0000 7fefcbfff700 1 -- 172.21.15.77:0/2229542627 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados osd op timeout}]=0 v22)=0 v22) v1 ==== 120+0+0 (secure 0 0 0) 0x7fefd4029020 con 0x7fefe415b180 2023-08-31T00:26:34.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 msgr2=0x7fefe42010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 0x7fefe42010f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fefd400d720 tx=0x7fefd400dae0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 shutdown_connections 2023-08-31T00:26:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fefe415b180 0x7fefe42010f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefe406c8c0 0x7fefe41591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 --2- 172.21.15.77:0/2229542627 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fefe415ada0 0x7fefe41fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 >> 172.21.15.77:0/2229542627 conn(0x7fefe40cccb0 msgr2=0x7fefe4071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 shutdown_connections 2023-08-31T00:26:34.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.418+0000 7fefe8a47700 1 -- 172.21.15.77:0/2229542627 wait complete. 2023-08-31T00:26:34.431 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-31T00:26:34.431 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-31T00:26:34.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-31T00:26:34.473 INFO:tasks.ceph.mgr.y:Started 2023-08-31T00:26:34.474 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-31T00:26:34.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-31T00:26:34.477 INFO:tasks.ceph.mgr.x:Started 2023-08-31T00:26:34.477 INFO:tasks.ceph:Setting crush tunables to default 2023-08-31T00:26:34.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2023-08-31T00:26:34.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 -- 172.21.15.77:0/1071286894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 msgr2=0x7fbfe40cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 --2- 172.21.15.77:0/1071286894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40cc250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00098c0 tx=0x7fbfe0009bd0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 -- 172.21.15.77:0/1071286894 shutdown_connections 2023-08-31T00:26:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 --2- 172.21.15.77:0/1071286894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40cc250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 --2- 172.21.15.77:0/1071286894 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfe406f130 0x7fbfe4070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 -- 172.21.15.77:0/1071286894 >> 172.21.15.77:0/1071286894 conn(0x7fbfe406cbf0 msgr2=0x7fbfe406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 -- 172.21.15.77:0/1071286894 shutdown_connections 2023-08-31T00:26:34.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.601+0000 7fbfec234700 1 -- 172.21.15.77:0/1071286894 wait complete. 2023-08-31T00:26:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.603+0000 7fbfec234700 1 Processor -- start 2023-08-31T00:26:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.603+0000 7fbfec234700 1 -- start start 2023-08-31T00:26:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfe406f130 0x7fbfe4150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfe4071000 0x7fbfe41e25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41e12d0 con 0x7fbfe41580f0 2023-08-31T00:26:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41e2130 con 0x7fbfe4071000 2023-08-31T00:26:34.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40c7de0 con 0x7fbfe406f130 2023-08-31T00:26:34.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37736/0 (socket says 172.21.15.77:37736) 2023-08-31T00:26:34.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 -- 172.21.15.77:0/366262956 learned_addr learned my addr 172.21.15.77:0/366262956 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:34.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfe9fd0700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfe406f130 0x7fbfe4150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfe97cf700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfe4071000 0x7fbfe41e25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:34.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 -- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfe406f130 msgr2=0x7fbfe4150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfe406f130 0x7fbfe4150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 -- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfe4071000 msgr2=0x7fbfe41e25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfe4071000 0x7fbfe41e25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 -- 172.21.15.77:0/366262956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0009520 con 0x7fbfe41580f0 2023-08-31T00:26:34.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfea7d1700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40c6eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cbc0 tx=0x7fbfdc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:34.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00aaa0 con 0x7fbfe41580f0 2023-08-31T00:26:34.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbfdc00acf0 con 0x7fbfe41580f0 2023-08-31T00:26:34.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe41e1520 con 0x7fbfe41580f0 2023-08-31T00:26:34.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00aea0 con 0x7fbfe41580f0 2023-08-31T00:26:34.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe41e1ae0 con 0x7fbfe41580f0 2023-08-31T00:26:34.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.604+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbfdc012980 con 0x7fbfe41580f0 2023-08-31T00:26:34.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.605+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbfdc01bb20 con 0x7fbfe41580f0 2023-08-31T00:26:34.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.605+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe41e22a0 con 0x7fbfe41580f0 2023-08-31T00:26:34.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.607+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbfdc03ab00 con 0x7fbfe41580f0 2023-08-31T00:26:34.667 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:34.667+0000 7f0a15047200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-31T00:26:34.668 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:34.667+0000 7f72924ad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-31T00:26:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.682+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbfe4073c30 con 0x7fbfe41580f0 2023-08-31T00:26:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.685+0000 7fbfda7fc700 1 -- 172.21.15.77:0/366262956 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbfdc029070 con 0x7fbfe41580f0 2023-08-31T00:26:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 msgr2=0x7fbfe40c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40c6eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00cbc0 tx=0x7fbfdc00ced0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 shutdown_connections 2023-08-31T00:26:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfe406f130 0x7fbfe4150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe41580f0 0x7fbfe40c6eb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 --2- 172.21.15.77:0/366262956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfe4071000 0x7fbfe41e25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 >> 172.21.15.77:0/366262956 conn(0x7fbfe406cbf0 msgr2=0x7fbfe40cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:34.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 shutdown_connections 2023-08-31T00:26:34.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:34.686+0000 7fbfec234700 1 -- 172.21.15.77:0/366262956 wait complete. 2023-08-31T00:26:34.689 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2023-08-31T00:26:34.698 INFO:tasks.ceph:check_enable_crimson: False 2023-08-31T00:26:34.699 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-31T00:26:34.699 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:34.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-31T00:26:34.726 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:34.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-31T00:26:34.732 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:34.733+0000 7f0a15047200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T00:26:34.737 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:34.737+0000 7f72924ad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T00:26:34.762 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:34.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-31T00:26:34.808 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:34.808+0000 7f0a15047200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T00:26:34.818 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:34.817+0000 7f72924ad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T00:26:34.830 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:26:34.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-31T00:26:34.885 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:34.886+0000 7f0a15047200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T00:26:34.896 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:34.896 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-31T00:26:34.905 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:34.902+0000 7f72924ad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T00:26:34.922 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:34.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-31T00:26:34.988 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:34.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-31T00:26:35.033 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:35.034+0000 7f0a15047200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T00:26:35.046 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:35.046+0000 7f72924ad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T00:26:35.055 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:26:35.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-31T00:26:35.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 8f8ee97c-b0be-408c-acbd-36ef632ab102 0 2023-08-31T00:26:35.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 -- 172.21.15.139:0/919802228 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b406a220 msgr2=0x7f12b40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 --2- 172.21.15.139:0/919802228 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b406a220 0x7f12b40cb530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009f90 tx=0x7f12ac00b330 comp rx=0 tx=0).stop 2023-08-31T00:26:35.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 -- 172.21.15.139:0/919802228 shutdown_connections 2023-08-31T00:26:35.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 --2- 172.21.15.139:0/919802228 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b406a220 0x7f12b40cb530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 -- 172.21.15.139:0/919802228 >> 172.21.15.139:0/919802228 conn(0x7f12b406cbf0 msgr2=0x7f12b406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 -- 172.21.15.139:0/919802228 shutdown_connections 2023-08-31T00:26:35.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.284+0000 7f12bb104700 1 -- 172.21.15.139:0/919802228 wait complete. 2023-08-31T00:26:35.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.286+0000 7f12bb104700 1 Processor -- start 2023-08-31T00:26:35.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.286+0000 7f12bb104700 1 -- start start 2023-08-31T00:26:35.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12bb104700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 0x7f12b40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12bb104700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b40caca0 0x7f12b414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12bb104700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 0x7f12b40b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12bb104700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b414d0c0 con 0x7f12b40caca0 2023-08-31T00:26:35.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12bb104700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40b1b60 con 0x7f12b406a220 2023-08-31T00:26:35.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12bb104700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40b2980 con 0x7f12b40cb080 2023-08-31T00:26:35.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b96a1700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 0x7f12b40b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b8ea0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 0x7f12b40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b96a1700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 0x7f12b40b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:57130/0 (socket says 172.21.15.139:57130) 2023-08-31T00:26:35.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b8ea0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 0x7f12b40c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37762/0 (socket says 172.21.15.139:37762) 2023-08-31T00:26:35.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b96a1700 1 -- 172.21.15.139:0/140923895 learned_addr learned my addr 172.21.15.139:0/140923895 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:35.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b3fff700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b40caca0 0x7f12b414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b8ea0700 1 -- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 msgr2=0x7f12b40b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b8ea0700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 0x7f12b40b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b8ea0700 1 -- 172.21.15.139:0/140923895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b40caca0 msgr2=0x7f12b414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.287+0000 7f12b8ea0700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b40caca0 0x7f12b414cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b8ea0700 1 -- 172.21.15.139:0/140923895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009c40 con 0x7f12b406a220 2023-08-31T00:26:35.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b96a1700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 0x7f12b40b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:26:35.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b8ea0700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 0x7f12b40c50f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12a800c450 tx=0x7f12a800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:35.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8011790 con 0x7f12b406a220 2023-08-31T00:26:35.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f12a80119e0 con 0x7f12b406a220 2023-08-31T00:26:35.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b40b1dd0 con 0x7f12b406a220 2023-08-31T00:26:35.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8011df0 con 0x7f12b406a220 2023-08-31T00:26:35.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b40b2610 con 0x7f12b406a220 2023-08-31T00:26:35.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f12a801c760 con 0x7f12b406a220 2023-08-31T00:26:35.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.288+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f12a8012850 con 0x7f12b406a220 2023-08-31T00:26:35.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.289+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b4073c30 con 0x7f12b406a220 2023-08-31T00:26:35.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.291+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f12a8012a60 con 0x7f12b406a220 2023-08-31T00:26:35.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.385+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f8ee97c-b0be-408c-acbd-36ef632ab102", "id": 0} v 0) v1 -- 0x7f12b40b20b0 con 0x7f12b406a220 2023-08-31T00:26:35.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.391+0000 7f12b17fa700 1 -- 172.21.15.139:0/140923895 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f8ee97c-b0be-408c-acbd-36ef632ab102", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f12a8012c00 con 0x7f12b406a220 2023-08-31T00:26:35.391 INFO:teuthology.orchestra.run.smithi139.stdout:0 2023-08-31T00:26:35.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 msgr2=0x7f12b40c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 0x7f12b40c50f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f12a800c450 tx=0x7f12a800c760 comp rx=0 tx=0).stop 2023-08-31T00:26:35.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 shutdown_connections 2023-08-31T00:26:35.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12b40cb080 0x7f12b40b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b406a220 0x7f12b40c50f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 --2- 172.21.15.139:0/140923895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12b40caca0 0x7f12b414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 >> 172.21.15.139:0/140923895 conn(0x7f12b406cbf0 msgr2=0x7f12b4069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 shutdown_connections 2023-08-31T00:26:35.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.392+0000 7f12bb104700 1 -- 172.21.15.139:0/140923895 wait complete. 2023-08-31T00:26:35.408 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new bf8126e9-6a74-4f00-ab1c-01bf3f975132 1 2023-08-31T00:26:35.438 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:35.437+0000 7f72924ad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T00:26:35.461 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:35.461+0000 7f0a15047200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T00:26:35.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 -- 172.21.15.139:0/4025774058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce80159260 msgr2=0x7fce800cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 --2- 172.21.15.139:0/4025774058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce80159260 0x7fce800cb3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fce80070730 tx=0x7fce7c009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:35.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 -- 172.21.15.139:0/4025774058 shutdown_connections 2023-08-31T00:26:35.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 --2- 172.21.15.139:0/4025774058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce80159260 0x7fce800cb3c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 --2- 172.21.15.139:0/4025774058 >> v2:172.21.15.77:3300/0 conn(0x7fce800b1fc0 0x7fce8015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 -- 172.21.15.139:0/4025774058 >> 172.21.15.139:0/4025774058 conn(0x7fce80069b10 msgr2=0x7fce80069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 -- 172.21.15.139:0/4025774058 shutdown_connections 2023-08-31T00:26:35.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.533+0000 7fce87cc2700 1 -- 172.21.15.139:0/4025774058 wait complete. 2023-08-31T00:26:35.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.534+0000 7fce87cc2700 1 Processor -- start 2023-08-31T00:26:35.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.534+0000 7fce87cc2700 1 -- start start 2023-08-31T00:26:35.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce87cc2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0c10 0x7fce80147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce87cc2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 0x7fce80147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce87cc2700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fce80159260 0x7fce800b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce87cc2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800c7e30 con 0x7fce800b0c10 2023-08-31T00:26:35.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce87cc2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800c3920 con 0x7fce800b1fc0 2023-08-31T00:26:35.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce87cc2700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800c3c00 con 0x7fce80159260 2023-08-31T00:26:35.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 0x7fce80147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8625f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fce80159260 0x7fce800b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 0x7fce80147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37776/0 (socket says 172.21.15.139:37776) 2023-08-31T00:26:35.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 -- 172.21.15.139:0/3438168291 learned_addr learned my addr 172.21.15.139:0/3438168291 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:35.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce85a5e700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0c10 0x7fce80147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 -- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fce80159260 msgr2=0x7fce800b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fce80159260 0x7fce800b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 -- 172.21.15.139:0/3438168291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0c10 msgr2=0x7fce80147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0c10 0x7fce80147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 -- 172.21.15.139:0/3438168291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c0095f0 con 0x7fce800b1fc0 2023-08-31T00:26:35.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce85a5e700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0c10 0x7fce80147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:26:35.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.535+0000 7fce8525d700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 0x7fce80147690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce7000e9a0 tx=0x7fce7000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:35.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70009790 con 0x7fce800b1fc0 2023-08-31T00:26:35.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce7000cb00 con 0x7fce800b1fc0 2023-08-31T00:26:35.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800c77e0 con 0x7fce800b1fc0 2023-08-31T00:26:35.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70010430 con 0x7fce800b1fc0 2023-08-31T00:26:35.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce800c35b0 con 0x7fce800b1fc0 2023-08-31T00:26:35.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce70010590 con 0x7fce800b1fc0 2023-08-31T00:26:35.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.536+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fce70014070 con 0x7fce800b1fc0 2023-08-31T00:26:35.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.537+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce800c7fa0 con 0x7fce800b1fc0 2023-08-31T00:26:35.545 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.539+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fce70026060 con 0x7fce800b1fc0 2023-08-31T00:26:35.553 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:35.553+0000 7f72924ad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T00:26:35.584 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:35.584+0000 7f0a15047200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T00:26:35.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.621+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf8126e9-6a74-4f00-ab1c-01bf3f975132", "id": 1} v 0) v1 -- 0x7fce80073c30 con 0x7fce800b1fc0 2023-08-31T00:26:35.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.625+0000 7fce767fc700 1 -- 172.21.15.139:0/3438168291 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf8126e9-6a74-4f00-ab1c-01bf3f975132", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce7002f0b0 con 0x7fce800b1fc0 2023-08-31T00:26:35.625 INFO:teuthology.orchestra.run.smithi139.stdout:1 2023-08-31T00:26:35.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.626+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 msgr2=0x7fce80147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.626+0000 7fce87cc2700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 0x7fce80147690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fce7000e9a0 tx=0x7fce7000ecb0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 shutdown_connections 2023-08-31T00:26:35.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fce80159260 0x7fce800b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce800b0c10 0x7fce80147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 --2- 172.21.15.139:0/3438168291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce800b1fc0 0x7fce80147690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 >> 172.21.15.139:0/3438168291 conn(0x7fce80069b10 msgr2=0x7fce801587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 shutdown_connections 2023-08-31T00:26:35.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.627+0000 7fce87cc2700 1 -- 172.21.15.139:0/3438168291 wait complete. 2023-08-31T00:26:35.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new bd3a1316-bda1-4a58-987b-dbe23924bb84 2 2023-08-31T00:26:35.639 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:35.639+0000 7f72924ad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T00:26:35.685 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:35.685+0000 7f0a15047200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T00:26:35.720 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:35.720+0000 7f72924ad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T00:26:35.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 -- 172.21.15.139:0/3483735828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 msgr2=0x7f9bac162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 --2- 172.21.15.139:0/3483735828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac162ec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009f60 tx=0x7f9ba4009f90 comp rx=0 tx=0).stop 2023-08-31T00:26:35.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 -- 172.21.15.139:0/3483735828 shutdown_connections 2023-08-31T00:26:35.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 --2- 172.21.15.139:0/3483735828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac162ec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 -- 172.21.15.139:0/3483735828 >> 172.21.15.139:0/3483735828 conn(0x7f9bac06cbf0 msgr2=0x7f9bac06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 -- 172.21.15.139:0/3483735828 shutdown_connections 2023-08-31T00:26:35.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.760+0000 7f9bb1536700 1 -- 172.21.15.139:0/3483735828 wait complete. 2023-08-31T00:26:35.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.761+0000 7f9bb1536700 1 Processor -- start 2023-08-31T00:26:35.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.761+0000 7f9bb1536700 1 -- start start 2023-08-31T00:26:35.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bb1536700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bac06f130 0x7f9bac14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bb1536700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bb1536700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 0x7f9bac0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bb1536700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac14c2d0 con 0x7f9bac06f130 2023-08-31T00:26:35.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bb1536700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac14b650 con 0x7f9bac0711d0 2023-08-31T00:26:35.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bb1536700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac14b930 con 0x7f9bac1580f0 2023-08-31T00:26:35.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bab7fe700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 0x7f9bac0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac0c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37788/0 (socket says 172.21.15.139:37788) 2023-08-31T00:26:35.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 -- 172.21.15.139:0/1055498718 learned_addr learned my addr 172.21.15.139:0/1055498718 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:35.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bab7fe700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 0x7f9bac0c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:57154/0 (socket says 172.21.15.139:57154) 2023-08-31T00:26:35.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baaffd700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bac06f130 0x7f9bac14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 -- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 msgr2=0x7f9bac0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 0x7f9bac0c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 -- 172.21.15.139:0/1055498718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bac06f130 msgr2=0x7f9bac14ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bac06f130 0x7f9bac14ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 -- 172.21.15.139:0/1055498718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009c40 con 0x7f9bac0711d0 2023-08-31T00:26:35.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baaffd700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bac06f130 0x7f9bac14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:26:35.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9bab7fe700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 0x7f9bac0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:26:35.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9baa7fc700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac0c3d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c4e0 tx=0x7f9ba000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:35.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.762+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00052d0 con 0x7f9bac0711d0 2023-08-31T00:26:35.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.763+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ba0005520 con 0x7f9bac0711d0 2023-08-31T00:26:35.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.763+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00038e0 con 0x7f9bac0711d0 2023-08-31T00:26:35.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.763+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac14bc10 con 0x7f9bac0711d0 2023-08-31T00:26:35.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.763+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9ba0003d40 con 0x7f9bac0711d0 2023-08-31T00:26:35.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.763+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac14b2a0 con 0x7f9bac0711d0 2023-08-31T00:26:35.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.763+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9ba00119b0 con 0x7f9bac0711d0 2023-08-31T00:26:35.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.764+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac14c410 con 0x7f9bac0711d0 2023-08-31T00:26:35.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.766+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9bac14c410 con 0x7f9bac0711d0 2023-08-31T00:26:35.771 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:35.769+0000 7f0a15047200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T00:26:35.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.850+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bd3a1316-bda1-4a58-987b-dbe23924bb84", "id": 2} v 0) v1 -- 0x7f9bac073c30 con 0x7f9bac0711d0 2023-08-31T00:26:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.854+0000 7f9b937fe700 1 -- 172.21.15.139:0/1055498718 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd3a1316-bda1-4a58-987b-dbe23924bb84", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ba0017070 con 0x7f9bac0711d0 2023-08-31T00:26:35.854 INFO:teuthology.orchestra.run.smithi139.stdout:2 2023-08-31T00:26:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 msgr2=0x7f9bac0c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac0c3d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c4e0 tx=0x7f9ba000c7f0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 shutdown_connections 2023-08-31T00:26:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bac1580f0 0x7f9bac0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bac06f130 0x7f9bac14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 --2- 172.21.15.139:0/1055498718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bac0711d0 0x7f9bac0c3d60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 >> 172.21.15.139:0/1055498718 conn(0x7f9bac06cbf0 msgr2=0x7f9bac0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 shutdown_connections 2023-08-31T00:26:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.855+0000 7f9bb1536700 1 -- 172.21.15.139:0/1055498718 wait complete. 2023-08-31T00:26:35.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 3e2033da-1071-4e72-a025-6cee65b2ccd9 3 2023-08-31T00:26:35.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 -- 172.21.15.139:0/1213203463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f05581580f0 msgr2=0x7f05580cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:35.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 --2- 172.21.15.139:0/1213203463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f05581580f0 0x7f05580cc250 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f054c005fd0 tx=0x7f054c009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:35.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 -- 172.21.15.139:0/1213203463 shutdown_connections 2023-08-31T00:26:35.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 --2- 172.21.15.139:0/1213203463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f05581580f0 0x7f05580cc250 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 --2- 172.21.15.139:0/1213203463 >> v2:172.21.15.77:3300/0 conn(0x7f055806f130 0x7f0558070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:35.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 -- 172.21.15.139:0/1213203463 >> 172.21.15.139:0/1213203463 conn(0x7f055806cbf0 msgr2=0x7f055806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:35.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 -- 172.21.15.139:0/1213203463 shutdown_connections 2023-08-31T00:26:35.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.993+0000 7f055c96d700 1 -- 172.21.15.139:0/1213203463 wait complete. 2023-08-31T00:26:35.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 Processor -- start 2023-08-31T00:26:35.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 -- start start 2023-08-31T00:26:35.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 0x7f0558152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 0x7f05580c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05581580f0 0x7f05580c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:35.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05580c4d30 con 0x7f05581580f0 2023-08-31T00:26:35.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05581f23a0 con 0x7f0558071000 2023-08-31T00:26:35.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055c96d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05581f14f0 con 0x7f055806f130 2023-08-31T00:26:35.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f0555d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 0x7f05580c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.995+0000 7f055659c700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 0x7f0558152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:35.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 0x7f0558152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:57162/0 (socket says 172.21.15.139:57162) 2023-08-31T00:26:35.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0555d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 0x7f05580c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37800/0 (socket says 172.21.15.139:37800) 2023-08-31T00:26:36.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 -- 172.21.15.139:0/4278199433 learned_addr learned my addr 172.21.15.139:0/4278199433 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:36.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0556d9d700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05581580f0 0x7f05580c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 -- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 msgr2=0x7f05580c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 0x7f05580c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 -- 172.21.15.139:0/4278199433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05581580f0 msgr2=0x7f05580c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05581580f0 0x7f05580c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 -- 172.21.15.139:0/4278199433 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0095f0 con 0x7f055806f130 2023-08-31T00:26:36.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0555d9b700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 0x7f05580c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:26:36.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055659c700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 0x7f0558152570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f05580cb8c0 tx=0x7f054c004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:36.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c01c070 con 0x7f055806f130 2023-08-31T00:26:36.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f054c004260 con 0x7f055806f130 2023-08-31T00:26:36.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05581f1790 con 0x7f055806f130 2023-08-31T00:26:36.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c003680 con 0x7f055806f130 2023-08-31T00:26:36.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05581f1b20 con 0x7f055806f130 2023-08-31T00:26:36.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f054c0037e0 con 0x7f055806f130 2023-08-31T00:26:36.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.996+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f054c0055a0 con 0x7f055806f130 2023-08-31T00:26:36.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.997+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558073c30 con 0x7f055806f130 2023-08-31T00:26:36.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:35.999+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f054c026020 con 0x7f055806f130 2023-08-31T00:26:36.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.081+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e2033da-1071-4e72-a025-6cee65b2ccd9", "id": 3} v 0) v1 -- 0x7f05580c8ad0 con 0x7f055806f130 2023-08-31T00:26:36.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.085+0000 7f0546ffd700 1 -- 172.21.15.139:0/4278199433 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e2033da-1071-4e72-a025-6cee65b2ccd9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f054c003c70 con 0x7f055806f130 2023-08-31T00:26:36.085 INFO:teuthology.orchestra.run.smithi139.stdout:3 2023-08-31T00:26:36.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 msgr2=0x7f0558152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 0x7f0558152570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f05580cb8c0 tx=0x7f054c004a60 comp rx=0 tx=0).stop 2023-08-31T00:26:36.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 shutdown_connections 2023-08-31T00:26:36.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f055806f130 0x7f0558152570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05581580f0 0x7f05580c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 --2- 172.21.15.139:0/4278199433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0558071000 0x7f05580c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 >> 172.21.15.139:0/4278199433 conn(0x7f055806cbf0 msgr2=0x7f05581536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 shutdown_connections 2023-08-31T00:26:36.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.086+0000 7f055c96d700 1 -- 172.21.15.139:0/4278199433 wait complete. 2023-08-31T00:26:36.097 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 5ff85074-9341-45ce-91e2-90ca00e5647e 4 2023-08-31T00:26:36.151 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:36.150+0000 7f72924ad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T00:26:36.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 -- 172.21.15.139:0/1232131775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec0cc640 msgr2=0x7fabec0aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 --2- 172.21.15.139:0/1232131775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec0cc640 0x7fabec0aca00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabd4005fd0 tx=0x7fabd4009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:36.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 -- 172.21.15.139:0/1232131775 shutdown_connections 2023-08-31T00:26:36.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 --2- 172.21.15.139:0/1232131775 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec06ab20 0x7fabec06af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 --2- 172.21.15.139:0/1232131775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec0cc640 0x7fabec0aca00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 -- 172.21.15.139:0/1232131775 >> 172.21.15.139:0/1232131775 conn(0x7fabec070270 msgr2=0x7fabec070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 -- 172.21.15.139:0/1232131775 shutdown_connections 2023-08-31T00:26:36.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.221+0000 7fabf1e79700 1 -- 172.21.15.139:0/1232131775 wait complete. 2023-08-31T00:26:36.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.222+0000 7fabf1e79700 1 Processor -- start 2023-08-31T00:26:36.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 -- start start 2023-08-31T00:26:36.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec06ab20 0x7fabec15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 0x7fabec152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabec15bb70 0x7fabec0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15cca0 con 0x7fabec15bb70 2023-08-31T00:26:36.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec155840 con 0x7fabec06ab20 2023-08-31T00:26:36.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabf1e79700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15d600 con 0x7fabec0cc640 2023-08-31T00:26:36.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabeb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec06ab20 0x7fabec15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabeaffd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 0x7fabec152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec06ab20 0x7fabec15d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37810/0 (socket says 172.21.15.139:37810) 2023-08-31T00:26:36.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.223+0000 7fabeaffd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 0x7fabec152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:57176/0 (socket says 172.21.15.139:57176) 2023-08-31T00:26:36.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeb7fe700 1 -- 172.21.15.139:0/696649155 learned_addr learned my addr 172.21.15.139:0/696649155 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:36.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabebfff700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabec15bb70 0x7fabec0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeaffd700 1 -- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec06ab20 msgr2=0x7fabec15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeaffd700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec06ab20 0x7fabec15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.230 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeaffd700 1 -- 172.21.15.139:0/696649155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabec15bb70 msgr2=0x7fabec0abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.230 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeaffd700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabec15bb70 0x7fabec0abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.230 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeaffd700 1 -- 172.21.15.139:0/696649155 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40095f0 con 0x7fabec0cc640 2023-08-31T00:26:36.230 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabeaffd700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 0x7fabec152cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fabd4015000 tx=0x7fabd4003d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:36.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd401d070 con 0x7fabec0cc640 2023-08-31T00:26:36.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fabd4004830 con 0x7fabec0cc640 2023-08-31T00:26:36.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec155280 con 0x7fabec0cc640 2023-08-31T00:26:36.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4004c40 con 0x7fabec0cc640 2023-08-31T00:26:36.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec15c8c0 con 0x7fabec0cc640 2023-08-31T00:26:36.232 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fabd400b820 con 0x7fabec0cc640 2023-08-31T00:26:36.232 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.224+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fabd40054e0 con 0x7fabec0cc640 2023-08-31T00:26:36.232 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.225+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec15cde0 con 0x7fabec0cc640 2023-08-31T00:26:36.232 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.227+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fabec15cde0 con 0x7fabec0cc640 2023-08-31T00:26:36.253 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:36.253+0000 7f0a15047200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T00:26:36.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.310+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5ff85074-9341-45ce-91e2-90ca00e5647e", "id": 4} v 0) v1 -- 0x7fabec073c30 con 0x7fabec0cc640 2023-08-31T00:26:36.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.314+0000 7fabe3fff700 1 -- 172.21.15.139:0/696649155 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ff85074-9341-45ce-91e2-90ca00e5647e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabd400bc60 con 0x7fabec0cc640 2023-08-31T00:26:36.314 INFO:teuthology.orchestra.run.smithi139.stdout:4 2023-08-31T00:26:36.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.315+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 msgr2=0x7fabec152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.315+0000 7fabf1e79700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 0x7fabec152cd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fabd4015000 tx=0x7fabd4003d00 comp rx=0 tx=0).stop 2023-08-31T00:26:36.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.315+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 shutdown_connections 2023-08-31T00:26:36.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.315+0000 7fabf1e79700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fabec15bb70 0x7fabec0abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.315+0000 7fabf1e79700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabec06ab20 0x7fabec15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.315+0000 7fabf1e79700 1 --2- 172.21.15.139:0/696649155 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fabec0cc640 0x7fabec152cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.316+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 >> 172.21.15.139:0/696649155 conn(0x7fabec070270 msgr2=0x7fabec155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.316+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 shutdown_connections 2023-08-31T00:26:36.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.316+0000 7fabf1e79700 1 -- 172.21.15.139:0/696649155 wait complete. 2023-08-31T00:26:36.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 4ec98b50-71ba-406d-a442-552ca3d6cd4c 5 2023-08-31T00:26:36.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 -- 172.21.15.139:0/4206652606 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 msgr2=0x7fdf00164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 --2- 172.21.15.139:0/4206652606 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf00164230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f90 tx=0x7fdef800b330 comp rx=0 tx=0).stop 2023-08-31T00:26:36.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 -- 172.21.15.139:0/4206652606 shutdown_connections 2023-08-31T00:26:36.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 --2- 172.21.15.139:0/4206652606 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf00164230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 -- 172.21.15.139:0/4206652606 >> 172.21.15.139:0/4206652606 conn(0x7fdf00070270 msgr2=0x7fdf00070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 -- 172.21.15.139:0/4206652606 shutdown_connections 2023-08-31T00:26:36.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.451+0000 7fdf059d8700 1 -- 172.21.15.139:0/4206652606 wait complete. 2023-08-31T00:26:36.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.452+0000 7fdf059d8700 1 Processor -- start 2023-08-31T00:26:36.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.452+0000 7fdf059d8700 1 -- start start 2023-08-31T00:26:36.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdf059d8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf000c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdf059d8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0006e6e0 0x7fdf001536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdf059d8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf000ace10 0x7fdf000c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdf059d8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf001f1b30 con 0x7fdf0006e6e0 2023-08-31T00:26:36.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdf059d8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0015a860 con 0x7fdf000ace10 2023-08-31T00:26:36.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdf059d8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000ac090 con 0x7fdf0006b230 2023-08-31T00:26:36.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdefeffd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf000c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdeff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf000ace10 0x7fdf000c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdefeffd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf000c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:57184/0 (socket says 172.21.15.139:57184) 2023-08-31T00:26:36.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdefeffd700 1 -- 172.21.15.139:0/3845891405 learned_addr learned my addr 172.21.15.139:0/3845891405 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:36.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.453+0000 7fdefe7fc700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0006e6e0 0x7fdf001536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdeff7fe700 1 -- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 msgr2=0x7fdf000c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdeff7fe700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf000c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdeff7fe700 1 -- 172.21.15.139:0/3845891405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0006e6e0 msgr2=0x7fdf001536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdeff7fe700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0006e6e0 0x7fdf001536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdeff7fe700 1 -- 172.21.15.139:0/3845891405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009c40 con 0x7fdf000ace10 2023-08-31T00:26:36.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdefeffd700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf000c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:26:36.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdeff7fe700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf000ace10 0x7fdf000c34f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdef8014000 tx=0x7fdef800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:36.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef800e040 con 0x7fdf000ace10 2023-08-31T00:26:36.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdef8004530 con 0x7fdf000ace10 2023-08-31T00:26:36.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0015ab00 con 0x7fdf000ace10 2023-08-31T00:26:36.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8004940 con 0x7fdf000ace10 2023-08-31T00:26:36.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.454+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0015b0c0 con 0x7fdf000ace10 2023-08-31T00:26:36.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.455+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdef801d780 con 0x7fdf000ace10 2023-08-31T00:26:36.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.455+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdef8012c30 con 0x7fdf000ace10 2023-08-31T00:26:36.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.455+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00073c30 con 0x7fdf000ace10 2023-08-31T00:26:36.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.457+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdef8017070 con 0x7fdf000ace10 2023-08-31T00:26:36.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.540+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ec98b50-71ba-406d-a442-552ca3d6cd4c", "id": 5} v 0) v1 -- 0x7fdf00065ec0 con 0x7fdf000ace10 2023-08-31T00:26:36.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.545+0000 7fdee7fff700 1 -- 172.21.15.139:0/3845891405 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ec98b50-71ba-406d-a442-552ca3d6cd4c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdef80126b0 con 0x7fdf000ace10 2023-08-31T00:26:36.545 INFO:teuthology.orchestra.run.smithi139.stdout:5 2023-08-31T00:26:36.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf000ace10 msgr2=0x7fdf000c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf000ace10 0x7fdf000c34f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdef8014000 tx=0x7fdef800bea0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 shutdown_connections 2023-08-31T00:26:36.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf0006b230 0x7fdf000c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf000ace10 0x7fdf000c34f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 --2- 172.21.15.139:0/3845891405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf0006e6e0 0x7fdf001536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 >> 172.21.15.139:0/3845891405 conn(0x7fdf00070270 msgr2=0x7fdf000b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 shutdown_connections 2023-08-31T00:26:36.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.546+0000 7fdf059d8700 1 -- 172.21.15.139:0/3845891405 wait complete. 2023-08-31T00:26:36.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 92ef0b62-f829-4063-a00b-b92da3625246 6 2023-08-31T00:26:36.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 -- 172.21.15.139:0/3720161758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 msgr2=0x7f1a380b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/3720161758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 0x7f1a380b17f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a28005c20 tx=0x7f1a28009990 comp rx=0 tx=0).stop 2023-08-31T00:26:36.703 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 -- 172.21.15.139:0/3720161758 shutdown_connections 2023-08-31T00:26:36.703 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/3720161758 >> v2:172.21.15.139:3300/0 conn(0x7f1a380b1d30 0x7f1a3816bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.703 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/3720161758 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 0x7f1a380b17f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.703 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 -- 172.21.15.139:0/3720161758 >> 172.21.15.139:0/3720161758 conn(0x7f1a3806a4d0 msgr2=0x7f1a380aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.703 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 -- 172.21.15.139:0/3720161758 shutdown_connections 2023-08-31T00:26:36.704 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.702+0000 7f1a3da9d700 1 -- 172.21.15.139:0/3720161758 wait complete. 2023-08-31T00:26:36.704 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.704+0000 7f1a3da9d700 1 Processor -- start 2023-08-31T00:26:36.705 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.704+0000 7f1a3da9d700 1 -- start start 2023-08-31T00:26:36.706 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.705+0000 7f1a3da9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 0x7f1a380a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.706 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.705+0000 7f1a3da9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a38165d70 0x7f1a3820f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.706 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.705+0000 7f1a3da9d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 0x7f1a3816a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.706 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a3da9d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380a64f0 con 0x7f1a380b1d30 2023-08-31T00:26:36.707 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a3da9d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380a8550 con 0x7f1a38165d70 2023-08-31T00:26:36.707 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a3da9d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380a8820 con 0x7f1a38169360 2023-08-31T00:26:36.707 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 0x7f1a380a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.707 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 0x7f1a380a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.139:49126/0 (socket says 172.21.15.139:49126) 2023-08-31T00:26:36.707 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 -- 172.21.15.139:0/938775477 learned_addr learned my addr 172.21.15.139:0/938775477 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a37fff700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 0x7f1a3816a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 -- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 msgr2=0x7f1a3816a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 0x7f1a3816a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 -- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a38165d70 msgr2=0x7f1a3820f2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T00:26:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a38165d70 0x7f1a3820f2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 -- 172.21.15.139:0/938775477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28009520 con 0x7f1a380b1d30 2023-08-31T00:26:36.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a377fe700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 0x7f1a380a8010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a30001980 tx=0x7f1a3000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:36.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.706+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30003e60 con 0x7f1a380b1d30 2023-08-31T00:26:36.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.707+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1a3000a970 con 0x7f1a380b1d30 2023-08-31T00:26:36.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.707+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000ad80 con 0x7f1a380b1d30 2023-08-31T00:26:36.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.707+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a380a8b00 con 0x7f1a380b1d30 2023-08-31T00:26:36.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.707+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3820f7e0 con 0x7f1a380b1d30 2023-08-31T00:26:36.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.708+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a30005370 con 0x7f1a380b1d30 2023-08-31T00:26:36.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.708+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1a300129f0 con 0x7f1a380b1d30 2023-08-31T00:26:36.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.708+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a38073c30 con 0x7f1a380b1d30 2023-08-31T00:26:36.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.710+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1a30017070 con 0x7f1a380b1d30 2023-08-31T00:26:36.785 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:36.785+0000 7f72924ad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T00:26:36.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.796+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92ef0b62-f829-4063-a00b-b92da3625246", "id": 6} v 0) v1 -- 0x7f1a38205e40 con 0x7f1a380b1d30 2023-08-31T00:26:36.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.799+0000 7f1a1ffff700 1 -- 172.21.15.139:0/938775477 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92ef0b62-f829-4063-a00b-b92da3625246", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a30005800 con 0x7f1a380b1d30 2023-08-31T00:26:36.799 INFO:teuthology.orchestra.run.smithi139.stdout:6 2023-08-31T00:26:36.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 msgr2=0x7f1a380a8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 0x7f1a380a8010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a30001980 tx=0x7f1a3000a340 comp rx=0 tx=0).stop 2023-08-31T00:26:36.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 shutdown_connections 2023-08-31T00:26:36.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a38169360 0x7f1a3816a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a380b1d30 0x7f1a380a8010 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1a30001980 tx=0x7f1a3000a340 comp rx=0 tx=0).stop 2023-08-31T00:26:36.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 --2- 172.21.15.139:0/938775477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a38165d70 0x7f1a3820f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 >> 172.21.15.139:0/938775477 conn(0x7f1a3806a4d0 msgr2=0x7f1a38169880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 shutdown_connections 2023-08-31T00:26:36.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.800+0000 7f1a3da9d700 1 -- 172.21.15.139:0/938775477 wait complete. 2023-08-31T00:26:36.812 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new c9ac674a-e1db-4d1d-b283-c9368e152feb 7 2023-08-31T00:26:36.855 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:36.854+0000 7f72924ad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T00:26:36.921 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:36.921+0000 7f0a15047200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T00:26:36.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 -- 172.21.15.139:0/3443848898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 msgr2=0x7ff6c00c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 --2- 172.21.15.139:0/3443848898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c00c97d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0066cd0 tx=0x7ff6bc009ba0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 -- 172.21.15.139:0/3443848898 shutdown_connections 2023-08-31T00:26:36.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 --2- 172.21.15.139:0/3443848898 >> v2:172.21.15.77:3300/0 conn(0x7ff6c015a020 0x7ff6c00c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 --2- 172.21.15.139:0/3443848898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c00c97d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 -- 172.21.15.139:0/3443848898 >> 172.21.15.139:0/3443848898 conn(0x7ff6c00cf180 msgr2=0x7ff6c00cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:36.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 -- 172.21.15.139:0/3443848898 shutdown_connections 2023-08-31T00:26:36.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.939+0000 7ff6c848e700 1 -- 172.21.15.139:0/3443848898 wait complete. 2023-08-31T00:26:36.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.940+0000 7ff6c848e700 1 Processor -- start 2023-08-31T00:26:36.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.940+0000 7ff6c848e700 1 -- start start 2023-08-31T00:26:36.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c848e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c01e4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c848e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c015a020 0x7ff6c0150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c848e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6c015dc10 0x7ff6c0150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:36.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c848e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0152ef0 con 0x7ff6c015a020 2023-08-31T00:26:36.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c848e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01522e0 con 0x7ff6c0159530 2023-08-31T00:26:36.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c848e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01525c0 con 0x7ff6c015dc10 2023-08-31T00:26:36.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c6a2b700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6c015dc10 0x7ff6c0150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c01e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c01e4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37842/0 (socket says 172.21.15.139:37842) 2023-08-31T00:26:36.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c6a2b700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6c015dc10 0x7ff6c0150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:57210/0 (socket says 172.21.15.139:57210) 2023-08-31T00:26:36.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 -- 172.21.15.139:0/4074816207 learned_addr learned my addr 172.21.15.139:0/4074816207 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-08-31T00:26:36.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c5a29700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c015a020 0x7ff6c0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:36.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 -- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6c015dc10 msgr2=0x7ff6c0150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6c015dc10 0x7ff6c0150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 -- 172.21.15.139:0/4074816207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c015a020 msgr2=0x7ff6c0150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:36.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c015a020 0x7ff6c0150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:36.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 -- 172.21.15.139:0/4074816207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc009520 con 0x7ff6c0159530 2023-08-31T00:26:36.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6c622a700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c01e4590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000c00 tx=0x7ff6bc00f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:36.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.941+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc025070 con 0x7ff6c0159530 2023-08-31T00:26:36.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff6bc00fb10 con 0x7ff6c0159530 2023-08-31T00:26:36.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc01b040 con 0x7ff6c0159530 2023-08-31T00:26:36.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c01528a0 con 0x7ff6c0159530 2023-08-31T00:26:36.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c01e4ad0 con 0x7ff6c0159530 2023-08-31T00:26:36.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6bc004830 con 0x7ff6c0159530 2023-08-31T00:26:36.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff6bc02aa70 con 0x7ff6c0159530 2023-08-31T00:26:36.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.942+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c01e4cc0 con 0x7ff6c0159530 2023-08-31T00:26:36.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:36.944+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff6bc004c20 con 0x7ff6c0159530 2023-08-31T00:26:36.994 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:36.994+0000 7f0a15047200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T00:26:37.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.027+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9ac674a-e1db-4d1d-b283-c9368e152feb", "id": 7} v 0) v1 -- 0x7ff6c0073c30 con 0x7ff6c0159530 2023-08-31T00:26:37.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.031+0000 7ff6b6ffd700 1 -- 172.21.15.139:0/4074816207 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9ac674a-e1db-4d1d-b283-c9368e152feb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6bc004dc0 con 0x7ff6c0159530 2023-08-31T00:26:37.031 INFO:teuthology.orchestra.run.smithi139.stdout:7 2023-08-31T00:26:37.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 msgr2=0x7ff6c01e4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:37.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c01e4590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc000c00 tx=0x7ff6bc00f710 comp rx=0 tx=0).stop 2023-08-31T00:26:37.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 shutdown_connections 2023-08-31T00:26:37.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6c015dc10 0x7ff6c0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6c0159530 0x7ff6c01e4590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 --2- 172.21.15.139:0/4074816207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6c015a020 0x7ff6c0150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 >> 172.21.15.139:0/4074816207 conn(0x7ff6c00cf180 msgr2=0x7ff6c0154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:37.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 shutdown_connections 2023-08-31T00:26:37.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:26:37.032+0000 7ff6c848e700 1 -- 172.21.15.139:0/4074816207 wait complete. 2023-08-31T00:26:37.043 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-31T00:26:37.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-31T00:26:37.046 INFO:tasks.ceph.osd.0:Started 2023-08-31T00:26:37.047 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-31T00:26:37.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-31T00:26:37.049 INFO:tasks.ceph.osd.1:Started 2023-08-31T00:26:37.050 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-31T00:26:37.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-31T00:26:37.052 INFO:tasks.ceph.osd.2:Started 2023-08-31T00:26:37.052 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-31T00:26:37.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-31T00:26:37.055 INFO:tasks.ceph.osd.3:Started 2023-08-31T00:26:37.055 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-31T00:26:37.055 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-31T00:26:37.058 INFO:tasks.ceph.osd.4:Started 2023-08-31T00:26:37.058 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-31T00:26:37.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-31T00:26:37.060 INFO:tasks.ceph.osd.5:Started 2023-08-31T00:26:37.061 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-31T00:26:37.061 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-31T00:26:37.063 INFO:tasks.ceph.osd.6:Started 2023-08-31T00:26:37.065 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-31T00:26:37.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-31T00:26:37.067 INFO:tasks.ceph.osd.7:Started 2023-08-31T00:26:37.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:26:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 -- 172.21.15.77:0/3086446861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168040 msgr2=0x7f911016bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 --2- 172.21.15.77:0/3086446861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168040 0x7f911016bd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f91100ccb60 tx=0x7f9100009ba0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 -- 172.21.15.77:0/3086446861 shutdown_connections 2023-08-31T00:26:37.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 --2- 172.21.15.77:0/3086446861 >> v2:172.21.15.139:3300/0 conn(0x7f9110088950 0x7f91100c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 --2- 172.21.15.77:0/3086446861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168040 0x7f911016bd00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 -- 172.21.15.77:0/3086446861 >> 172.21.15.77:0/3086446861 conn(0x7f91100aea90 msgr2=0x7f91100aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 -- 172.21.15.77:0/3086446861 shutdown_connections 2023-08-31T00:26:37.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.215+0000 7f91166e3700 1 -- 172.21.15.77:0/3086446861 wait complete. 2023-08-31T00:26:37.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.216+0000 7f91166e3700 1 Processor -- start 2023-08-31T00:26:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.216+0000 7f91166e3700 1 -- start start 2023-08-31T00:26:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f91166e3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9110088950 0x7f9110166770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f91166e3700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9110168040 0x7f91101f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f91166e3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 0x7f911016aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:37.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f91166e3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101f4bd0 con 0x7f9110168420 2023-08-31T00:26:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f91166e3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101f4eb0 con 0x7f9110088950 2023-08-31T00:26:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f91166e3700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91101f5190 con 0x7f9110168040 2023-08-31T00:26:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 0x7f911016aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 0x7f911016aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37772/0 (socket says 172.21.15.77:37772) 2023-08-31T00:26:37.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 -- 172.21.15.77:0/3373784755 learned_addr learned my addr 172.21.15.77:0/3373784755 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f910f7fe700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9110168040 0x7f91101f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f910ffff700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9110088950 0x7f9110166770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 -- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9110168040 msgr2=0x7f91101f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9110168040 0x7f91101f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 -- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9110088950 msgr2=0x7f9110166770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:37.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9110088950 0x7f9110166770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 -- 172.21.15.77:0/3373784755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100009520 con 0x7f9110168420 2023-08-31T00:26:37.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f9114c80700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 0x7f911016aa20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9108007e90 tx=0x7f910800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:37.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.217+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108011070 con 0x7f9110168420 2023-08-31T00:26:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91101f5470 con 0x7f9110168420 2023-08-31T00:26:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9108004bb0 con 0x7f9110168420 2023-08-31T00:26:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108009d50 con 0x7f9110168420 2023-08-31T00:26:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9110166cb0 con 0x7f9110168420 2023-08-31T00:26:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f910800ca10 con 0x7f9110168420 2023-08-31T00:26:37.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9108016470 con 0x7f9110168420 2023-08-31T00:26:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.218+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91101f5990 con 0x7f9110168420 2023-08-31T00:26:37.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.221+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f91101f5990 con 0x7f9110168420 2023-08-31T00:26:37.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.289+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9110073c30 con 0x7f9110168420 2023-08-31T00:26:37.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.289+0000 7f910cff9700 1 -- 172.21.15.77:0/3373784755 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f910801a020 con 0x7f9110168420 2023-08-31T00:26:37.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:26:37.291 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:37.028623+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:26:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 msgr2=0x7f911016aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 0x7f911016aa20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9108007e90 tx=0x7f910800c3a0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 shutdown_connections 2023-08-31T00:26:37.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9110168420 0x7f911016aa20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9110088950 0x7f9110166770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 --2- 172.21.15.77:0/3373784755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9110168040 0x7f91101f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 >> 172.21.15.77:0/3373784755 conn(0x7f91100aea90 msgr2=0x7f9110167680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 shutdown_connections 2023-08-31T00:26:37.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:37.290+0000 7f91166e3700 1 -- 172.21.15.77:0/3373784755 wait complete. 2023-08-31T00:26:37.303 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-31T00:26:37.303 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-31T00:26:37.594 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:37.594+0000 7f72924ad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T00:26:37.664 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-08-31T00:26:37.663+0000 7f4fa8dcf640 -1 Falling back to public interface 2023-08-31T00:26:37.664 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T00:26:37.664+0000 7fa9d2c02640 -1 Falling back to public interface 2023-08-31T00:26:37.670 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T00:26:37.670+0000 7f2db278a640 -1 Falling back to public interface 2023-08-31T00:26:37.672 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:37.671+0000 7f72924ad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-31T00:26:37.677 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T00:26:37.676+0000 7f6347085640 -1 Falling back to public interface 2023-08-31T00:26:37.677 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T00:26:37.676+0000 7fb1ec96e640 -1 Falling back to public interface 2023-08-31T00:26:37.681 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-08-31T00:26:37.680+0000 7f3e2b36a640 -1 Falling back to public interface 2023-08-31T00:26:37.685 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T00:26:37.685+0000 7f73bd248640 -1 Falling back to public interface 2023-08-31T00:26:37.690 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T00:26:37.690+0000 7fb6e836f640 -1 Falling back to public interface 2023-08-31T00:26:37.713 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:37.713+0000 7f0a15047200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T00:26:37.790 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:37.790+0000 7f0a15047200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-31T00:26:37.818 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:37.817+0000 7f72924ad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T00:26:37.929 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:37.929+0000 7f0a15047200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T00:26:38.056 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:38.056+0000 7f72924ad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-31T00:26:38.109 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T00:26:38.164 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:38.164+0000 7f0a15047200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-31T00:26:38.227 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.226+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/2968361954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf806e580 msgr2=0x7f3bf80b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:38.228 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.226+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/2968361954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf806e580 0x7f3bf80b1ff0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009f60 tx=0x7f3bf0009f90 comp rx=0 tx=0).stop 2023-08-31T00:26:38.228 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.227+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/2968361954 shutdown_connections 2023-08-31T00:26:38.228 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.227+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/2968361954 >> v2:172.21.15.139:3300/0 conn(0x7f3bf8159420 0x7f3bf806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.228 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.227+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/2968361954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf806e580 0x7f3bf80b1ff0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.229 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.227+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/2968361954 >> 172.21.15.77:0/2968361954 conn(0x7f3bf80cf1a0 msgr2=0x7f3bf80cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:38.229 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.227+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/2968361954 shutdown_connections 2023-08-31T00:26:38.229 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.227+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/2968361954 wait complete. 2023-08-31T00:26:38.232 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.228+0000 7f3bfd7ec700 1 Processor -- start 2023-08-31T00:26:38.232 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.228+0000 7f3bfd7ec700 1 -- start start 2023-08-31T00:26:38.232 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bf806e580 0x7f3bf80aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:38.232 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 0x7f3bf806ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:38.232 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf8159420 0x7f3bf81498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:38.233 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf806c2f0 con 0x7f3bf80ce710 2023-08-31T00:26:38.233 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf806b670 con 0x7f3bf806e580 2023-08-31T00:26:38.233 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf806b950 con 0x7f3bf8159420 2023-08-31T00:26:38.233 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 0x7f3bf806ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:38.234 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 0x7f3bf806ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37782/0 (socket says 172.21.15.77:37782) 2023-08-31T00:26:38.234 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 -- 172.21.15.77:0/3175616541 learned_addr learned my addr 172.21.15.77:0/3175616541 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:38.234 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf77fe700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf8159420 0x7f3bf81498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:38.234 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf6ffd700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bf806e580 0x7f3bf80aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:38.235 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 -- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf8159420 msgr2=0x7f3bf81498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:38.235 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf8159420 0x7f3bf81498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.235 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 -- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bf806e580 msgr2=0x7f3bf80aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:38.235 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bf806e580 0x7f3bf80aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.235 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 -- 172.21.15.77:0/3175616541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009520 con 0x7f3bf80ce710 2023-08-31T00:26:38.236 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bf67fc700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 0x7f3bf806ac20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c700 tx=0x7f3bec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:38.236 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec005230 con 0x7f3bf80ce710 2023-08-31T00:26:38.236 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3bec005480 con 0x7f3bf80ce710 2023-08-31T00:26:38.236 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec004990 con 0x7f3bf80ce710 2023-08-31T00:26:38.236 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.229+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf0009c40 con 0x7f3bf80ce710 2023-08-31T00:26:38.237 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.230+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf806bf10 con 0x7f3bf80ce710 2023-08-31T00:26:38.237 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.230+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3bec011590 con 0x7f3bf80ce710 2023-08-31T00:26:38.237 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.230+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3bec012af0 con 0x7f3bf80ce710 2023-08-31T00:26:38.237 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.230+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf806c560 con 0x7f3bf80ce710 2023-08-31T00:26:38.238 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.232+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3bec017070 con 0x7f3bf80ce710 2023-08-31T00:26:38.273 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:38.273+0000 7f72924ad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T00:26:38.302 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.302+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bf804e7c0 con 0x7f3bf80ce710 2023-08-31T00:26:38.303 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.302+0000 7f3bdf7fe700 1 -- 172.21.15.77:0/3175616541 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3bec011a20 con 0x7f3bf80ce710 2023-08-31T00:26:38.304 INFO:teuthology.misc.health.smithi077.stdout: 2023-08-31T00:26:38.304 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:37.028623+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:26:38.305 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 msgr2=0x7f3bf806ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:38.305 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 0x7f3bf806ac20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c700 tx=0x7f3bec00ca10 comp rx=0 tx=0).stop 2023-08-31T00:26:38.305 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 shutdown_connections 2023-08-31T00:26:38.305 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3bf8159420 0x7f3bf81498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.306 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bf806e580 0x7f3bf80aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.306 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 --2- 172.21.15.77:0/3175616541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bf80ce710 0x7f3bf806ac20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:38.306 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 >> 172.21.15.77:0/3175616541 conn(0x7f3bf80cf1a0 msgr2=0x7f3bf806de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:38.306 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.303+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 shutdown_connections 2023-08-31T00:26:38.306 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:38.304+0000 7f3bfd7ec700 1 -- 172.21.15.77:0/3175616541 wait complete. 2023-08-31T00:26:38.315 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-31T00:26:38.381 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:38.380+0000 7f0a15047200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T00:26:38.407 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:38.406+0000 7f72924ad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T00:26:38.513 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:38.513+0000 7f0a15047200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T00:26:38.626 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:38.626+0000 7f72924ad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T00:26:38.729 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:38.729+0000 7f0a15047200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T00:26:38.782 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:38.781+0000 7f72924ad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T00:26:38.885 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:38.885+0000 7f0a15047200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T00:26:38.897 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:38.896+0000 7f72924ad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T00:26:38.998 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:38.999+0000 7f0a15047200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T00:26:39.215 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:39.214+0000 7f72924ad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T00:26:39.315 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:39.314+0000 7f72924ad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T00:26:39.322 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:39.323+0000 7f0a15047200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T00:26:39.423 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:39.423+0000 7f0a15047200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T00:26:39.501 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:39.501+0000 7f72924ad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T00:26:39.608 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:39.609+0000 7f0a15047200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T00:26:40.094 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:40.093+0000 7f72924ad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T00:26:40.212 INFO:tasks.ceph.mgr.x.smithi139.stderr:2023-08-31T00:26:40.212+0000 7f0a15047200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T00:26:41.118 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:41.118+0000 7f724a4b7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-31T00:26:41.119 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-08-31T00:26:41.118+0000 7f724a4b7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-31T00:26:41.168 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T00:26:41.169+0000 7fa9d2c02640 -1 osd.4 0 log_to_monitors true 2023-08-31T00:26:41.202 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T00:26:41.202+0000 7f2db278a640 -1 osd.5 0 log_to_monitors true 2023-08-31T00:26:41.203 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-08-31T00:26:41.203+0000 7f4fa8dcf640 -1 osd.0 0 log_to_monitors true 2023-08-31T00:26:41.233 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T00:26:41.233+0000 7f73bd248640 -1 osd.7 0 log_to_monitors true 2023-08-31T00:26:41.233 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T00:26:41.234+0000 7fb6e836f640 -1 osd.6 0 log_to_monitors true 2023-08-31T00:26:41.237 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T00:26:41.237+0000 7f6347085640 -1 osd.2 0 log_to_monitors true 2023-08-31T00:26:41.245 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T00:26:41.245+0000 7fb1ec96e640 -1 osd.3 0 log_to_monitors true 2023-08-31T00:26:41.260 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-08-31T00:26:41.259+0000 7f3e2b36a640 -1 osd.1 0 log_to_monitors true 2023-08-31T00:26:45.071 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T00:26:45.071+0000 7f633c43f700 -1 osd.2 0 waiting for initial osdmap 2023-08-31T00:26:45.086 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T00:26:45.087+0000 7f6333017700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.088 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T00:26:45.089+0000 7fb1e0525700 -1 osd.3 0 waiting for initial osdmap 2023-08-31T00:26:45.097 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T00:26:45.098+0000 7fb1d8900700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.119 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-08-31T00:26:45.120+0000 7f4f9c986700 -1 osd.0 0 waiting for initial osdmap 2023-08-31T00:26:45.122 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T00:26:45.131 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-08-31T00:26:45.132+0000 7f3e20724700 -1 osd.1 0 waiting for initial osdmap 2023-08-31T00:26:45.131 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-08-31T00:26:45.132+0000 7f4f94d61700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.141 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-08-31T00:26:45.142+0000 7f3e172fc700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.144 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T00:26:45.144+0000 7f2da6341700 -1 osd.5 0 waiting for initial osdmap 2023-08-31T00:26:45.161 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T00:26:45.160+0000 7f2d9e71c700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.164 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T00:26:45.164+0000 7fa9c67b9700 -1 osd.4 0 waiting for initial osdmap 2023-08-31T00:26:45.172 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T00:26:45.171+0000 7f73b2602700 -1 osd.7 0 waiting for initial osdmap 2023-08-31T00:26:45.176 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T00:26:45.176+0000 7fa9beb94700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.184 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T00:26:45.184+0000 7f73a91da700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.203 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T00:26:45.203+0000 7fb6dbf26700 -1 osd.6 0 waiting for initial osdmap 2023-08-31T00:26:45.214 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T00:26:45.214+0000 7fb6d4301700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T00:26:45.240 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f550cfaf700 1 -- 172.21.15.77:0/3053536675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f0003bc0 msgr2=0x7f54f0003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:45.240 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3053536675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f54f0003bc0 0x7f54f0003fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f54fc001890 tx=0x7f54f0005880 comp rx=0 tx=0).stop 2023-08-31T00:26:45.241 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f5506d9d700 1 -- 172.21.15.77:0/3053536675 reap_dead start 2023-08-31T00:26:45.241 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f550cfaf700 1 -- 172.21.15.77:0/3053536675 shutdown_connections 2023-08-31T00:26:45.241 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f550cfaf700 1 -- 172.21.15.77:0/3053536675 >> 172.21.15.77:0/3053536675 conn(0x7f550806cbf0 msgr2=0x7f550806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:45.241 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f550cfaf700 1 -- 172.21.15.77:0/3053536675 shutdown_connections 2023-08-31T00:26:45.242 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.240+0000 7f550cfaf700 1 -- 172.21.15.77:0/3053536675 wait complete. 2023-08-31T00:26:45.245 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.241+0000 7f550cfaf700 1 Processor -- start 2023-08-31T00:26:45.245 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 -- start start 2023-08-31T00:26:45.245 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f54f0003bc0 0x7f55081f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:45.245 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55081f2910 0x7f55080aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:45.245 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 0x7f55080b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:45.246 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55081f5eb0 con 0x7f55080af240 2023-08-31T00:26:45.246 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080af6d0 con 0x7f55081f2910 2023-08-31T00:26:45.246 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f550cfaf700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55081f52a0 con 0x7f54f0003bc0 2023-08-31T00:26:45.246 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f5506d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 0x7f55080b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:45.246 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f5506d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 0x7f55080b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37898/0 (socket says 172.21.15.77:37898) 2023-08-31T00:26:45.247 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.242+0000 7f5506d9d700 1 -- 172.21.15.77:0/3942923684 learned_addr learned my addr 172.21.15.77:0/3942923684 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:45.247 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f550659c700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f54f0003bc0 0x7f55081f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:45.247 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5505d9b700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55081f2910 0x7f55080aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:45.247 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5506d9d700 1 -- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f54f0003bc0 msgr2=0x7f55081f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:45.247 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5506d9d700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f54f0003bc0 0x7f55081f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:45.248 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5506d9d700 1 -- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55081f2910 msgr2=0x7f55080aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:45.248 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5506d9d700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55081f2910 0x7f55080aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:45.248 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5506d9d700 1 -- 172.21.15.77:0/3942923684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55081f5510 con 0x7f55080af240 2023-08-31T00:26:45.248 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f5506d9d700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 0x7f55080b2870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55080cb750 tx=0x7f550000f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:45.249 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000e040 con 0x7f55080af240 2023-08-31T00:26:45.249 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f550000f040 con 0x7f55080af240 2023-08-31T00:26:45.249 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55081f57f0 con 0x7f55080af240 2023-08-31T00:26:45.249 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011ec0 con 0x7f55080af240 2023-08-31T00:26:45.249 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.243+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55080b2db0 con 0x7f55080af240 2023-08-31T00:26:45.250 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.244+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55080ad700 con 0x7f55080af240 2023-08-31T00:26:45.250 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.244+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f5500003a00 con 0x7f55080af240 2023-08-31T00:26:45.250 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.245+0000 7f54f6ffd700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f54e806a050 0x7f54e806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:45.250 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.245+0000 7f550659c700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f54e806a050 0x7f54e806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:45.250 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.245+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f5500087da0 con 0x7f55080af240 2023-08-31T00:26:45.251 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.245+0000 7f550659c700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f54e806a050 0x7f54e806c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f54fc001eb0 tx=0x7f54fc001340 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:45.251 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.249+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f55000543f0 con 0x7f55080af240 2023-08-31T00:26:45.438 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.439+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55081f5ff0 con 0x7f55080af240 2023-08-31T00:26:45.439 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.439+0000 7f54f6ffd700 1 -- 172.21.15.77:0/3942923684 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f55081f5ff0 con 0x7f55080af240 2023-08-31T00:26:45.439 INFO:teuthology.misc.health.smithi077.stdout: 2023-08-31T00:26:45.439 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":12,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:43.115388+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:26:45.441 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f54e806a050 msgr2=0x7f54e806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:45.441 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f54e806a050 0x7f54e806c510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f54fc001eb0 tx=0x7f54fc001340 comp rx=0 tx=0).stop 2023-08-31T00:26:45.442 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 msgr2=0x7f55080b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:45.442 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 0x7f55080b2870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55080cb750 tx=0x7f550000f770 comp rx=0 tx=0).stop 2023-08-31T00:26:45.442 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 shutdown_connections 2023-08-31T00:26:45.442 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f54e806a050 0x7f54e806c510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:45.442 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f54f0003bc0 0x7f55081f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:45.443 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55080af240 0x7f55080b2870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:45.443 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 --2- 172.21.15.77:0/3942923684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55081f2910 0x7f55080aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:45.443 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.441+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 >> 172.21.15.77:0/3942923684 conn(0x7f550806cbf0 msgr2=0x7f55081515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:45.443 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.442+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 shutdown_connections 2023-08-31T00:26:45.443 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:45.442+0000 7f550cfaf700 1 -- 172.21.15.77:0/3942923684 wait complete. 2023-08-31T00:26:45.452 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-31T00:26:52.260 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T00:26:52.386 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 -- 172.21.15.77:0/538207615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 msgr2=0x7fc74c0c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.386 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 --2- 172.21.15.77:0/538207615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c0c92a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc74c067460 tx=0x7fc73c009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:52.386 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 -- 172.21.15.77:0/538207615 shutdown_connections 2023-08-31T00:26:52.387 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 --2- 172.21.15.77:0/538207615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c0c92a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.387 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 --2- 172.21.15.77:0/538207615 >> v2:172.21.15.139:3300/0 conn(0x7fc74c1587c0 0x7fc74c070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.387 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 -- 172.21.15.77:0/538207615 >> 172.21.15.77:0/538207615 conn(0x7fc74c06cbf0 msgr2=0x7fc74c06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:52.387 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 -- 172.21.15.77:0/538207615 shutdown_connections 2023-08-31T00:26:52.387 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.385+0000 7fc7524e5700 1 -- 172.21.15.77:0/538207615 wait complete. 2023-08-31T00:26:52.389 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.386+0000 7fc7524e5700 1 Processor -- start 2023-08-31T00:26:52.390 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 -- start start 2023-08-31T00:26:52.390 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc74c071000 0x7fc74c0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.390 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.390 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc74c1587c0 0x7fc74c1f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.390 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c1f1770 con 0x7fc74c1583e0 2023-08-31T00:26:52.391 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0b2520 con 0x7fc74c1587c0 2023-08-31T00:26:52.391 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.387+0000 7fc7524e5700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0b1c80 con 0x7fc74c071000 2023-08-31T00:26:52.391 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:52.391 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38120/0 (socket says 172.21.15.77:38120) 2023-08-31T00:26:52.392 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 -- 172.21.15.77:0/283914291 learned_addr learned my addr 172.21.15.77:0/283914291 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:52.392 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 -- 172.21.15.77:0/283914291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc74c071000 msgr2=0x7fc74c0b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.392 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc74c071000 0x7fc74c0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.392 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 -- 172.21.15.77:0/283914291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc74c1587c0 msgr2=0x7fc74c1f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.392 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc74c1587c0 0x7fc74c1f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.393 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 -- 172.21.15.77:0/283914291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0095f0 con 0x7fc74c1583e0 2023-08-31T00:26:52.393 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc74b7fe700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c159ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc73400d950 tx=0x7fc73400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:52.393 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734009930 con 0x7fc74c1583e0 2023-08-31T00:26:52.393 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc734009b80 con 0x7fc74c1583e0 2023-08-31T00:26:52.393 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734010460 con 0x7fc74c1583e0 2023-08-31T00:26:52.394 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c0b1f60 con 0x7fc74c1583e0 2023-08-31T00:26:52.394 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.388+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c15a010 con 0x7fc74c1583e0 2023-08-31T00:26:52.394 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.389+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c1f15d0 con 0x7fc74c1583e0 2023-08-31T00:26:52.395 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.389+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc7340105c0 con 0x7fc74c1583e0 2023-08-31T00:26:52.395 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.390+0000 7fc748ff9700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc72c06a0e0 0x7fc72c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.396 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.390+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7340884a0 con 0x7fc74c1583e0 2023-08-31T00:26:52.396 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.390+0000 7fc74bfff700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc72c06a0e0 0x7fc72c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:52.396 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.390+0000 7fc74bfff700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc72c06a0e0 0x7fc72c06c5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc73c000c00 tx=0x7fc73c004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:52.396 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.394+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc74c1f15d0 con 0x7fc74c1583e0 2023-08-31T00:26:52.584 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.584+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc74c1f15d0 con 0x7fc74c1583e0 2023-08-31T00:26:52.585 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.584+0000 7fc748ff9700 1 -- 172.21.15.77:0/283914291 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fc734080e60 con 0x7fc74c1583e0 2023-08-31T00:26:52.585 INFO:teuthology.misc.health.smithi077.stdout: 2023-08-31T00:26:52.586 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":16,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:49.139226+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:26:52.587 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc72c06a0e0 msgr2=0x7fc72c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.588 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc72c06a0e0 0x7fc72c06c5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc73c000c00 tx=0x7fc73c004750 comp rx=0 tx=0).stop 2023-08-31T00:26:52.588 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 msgr2=0x7fc74c159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.588 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c159ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc73400d950 tx=0x7fc73400dd10 comp rx=0 tx=0).stop 2023-08-31T00:26:52.588 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 shutdown_connections 2023-08-31T00:26:52.589 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc72c06a0e0 0x7fc72c06c5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.589 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc74c071000 0x7fc74c0b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.589 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc74c1587c0 0x7fc74c1f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.589 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 --2- 172.21.15.77:0/283914291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc74c1583e0 0x7fc74c159ad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.589 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 >> 172.21.15.77:0/283914291 conn(0x7fc74c06cbf0 msgr2=0x7fc74c157510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:52.590 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 shutdown_connections 2023-08-31T00:26:52.590 INFO:teuthology.misc.health.smithi077.stderr:2023-08-31T00:26:52.587+0000 7fc7524e5700 1 -- 172.21.15.77:0/283914291 wait complete. 2023-08-31T00:26:52.598 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-31T00:26:52.599 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-31T00:26:52.599 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T00:26:52.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T00:26:52.602 INFO:tasks.ceph.mds.a:Started 2023-08-31T00:26:52.602 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T00:26:52.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T00:26:52.604 INFO:tasks.ceph.mds.c:Started 2023-08-31T00:26:52.605 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T00:26:52.605 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T00:26:52.608 INFO:tasks.ceph.mds.b:Started 2023-08-31T00:26:52.608 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T00:26:52.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T00:26:52.611 INFO:tasks.ceph.mds.d:Started 2023-08-31T00:26:52.611 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-31T00:26:52.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:26:52.680 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-08-31T00:26:52.681 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-08-31T00:26:52.697 INFO:tasks.ceph.mds.d.smithi139.stdout:starting mds.d at 2023-08-31T00:26:52.697 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2023-08-31T00:26:52.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.741+0000 7fa649b01700 1 -- 172.21.15.77:0/3152704800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440b1340 msgr2=0x7fa6440b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.741+0000 7fa649b01700 1 --2- 172.21.15.77:0/3152704800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440b1340 0x7fa6440b4120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009fd0 tx=0x7fa63c00b380 comp rx=0 tx=0).stop 2023-08-31T00:26:52.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.742+0000 7fa649b01700 1 -- 172.21.15.77:0/3152704800 shutdown_connections 2023-08-31T00:26:52.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.742+0000 7fa649b01700 1 --2- 172.21.15.77:0/3152704800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440b1340 0x7fa6440b4120 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.742+0000 7fa649b01700 1 --2- 172.21.15.77:0/3152704800 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa644159450 0x7fa6440c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.742+0000 7fa649b01700 1 -- 172.21.15.77:0/3152704800 >> 172.21.15.77:0/3152704800 conn(0x7fa6440cbc30 msgr2=0x7fa6440cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.742+0000 7fa649b01700 1 -- 172.21.15.77:0/3152704800 shutdown_connections 2023-08-31T00:26:52.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.742+0000 7fa649b01700 1 -- 172.21.15.77:0/3152704800 wait complete. 2023-08-31T00:26:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.743+0000 7fa649b01700 1 Processor -- start 2023-08-31T00:26:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.743+0000 7fa649b01700 1 -- start start 2023-08-31T00:26:52.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440b1340 0x7fa6441529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 0x7fa6440c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa644159450 0x7fa6440c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64406ae50 con 0x7fa6440c9d40 2023-08-31T00:26:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c34f0 con 0x7fa644159450 2023-08-31T00:26:52.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c8350 con 0x7fa6440b1340 2023-08-31T00:26:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 0x7fa6440c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 0x7fa6440c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38160/0 (socket says 172.21.15.77:38160) 2023-08-31T00:26:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 -- 172.21.15.77:0/1934003451 learned_addr learned my addr 172.21.15.77:0/1934003451 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa6437fe700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440b1340 0x7fa6441529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:52.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa643fff700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa644159450 0x7fa6440c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 -- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440b1340 msgr2=0x7fa6441529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440b1340 0x7fa6441529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 -- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa644159450 msgr2=0x7fa6440c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa644159450 0x7fa6440c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 -- 172.21.15.77:0/1934003451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009d00 con 0x7fa6440c9d40 2023-08-31T00:26:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa6437fe700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440b1340 0x7fa6441529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa643fff700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa644159450 0x7fa6440c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa642ffd700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 0x7fa6440c2fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c4d0 tx=0x7fa63800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638011790 con 0x7fa6440c9d40 2023-08-31T00:26:52.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa6380119e0 con 0x7fa6440c9d40 2023-08-31T00:26:52.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6440c7810 con 0x7fa6440c9d40 2023-08-31T00:26:52.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638011df0 con 0x7fa6440c9d40 2023-08-31T00:26:52.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.744+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6440c7d90 con 0x7fa6440c9d40 2023-08-31T00:26:52.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.745+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa644073c30 con 0x7fa6440c9d40 2023-08-31T00:26:52.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.746+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa63801c460 con 0x7fa6440c9d40 2023-08-31T00:26:52.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.746+0000 7fa62bfff700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa63006a0e0 0x7fa63006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:52.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.746+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa638088050 con 0x7fa6440c9d40 2023-08-31T00:26:52.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.746+0000 7fa6437fe700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa63006a0e0 0x7fa63006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:52.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.747+0000 7fa6437fe700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa63006a0e0 0x7fa63006c5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa634005fd0 tx=0x7fa634005e60 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:52.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.751+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa638053c10 con 0x7fa6440c9d40 2023-08-31T00:26:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.942+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa644152f20 con 0x7fa6440c9d40 2023-08-31T00:26:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.943+0000 7fa62bfff700 1 -- 172.21.15.77:0/1934003451 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fa638057230 con 0x7fa6440c9d40 2023-08-31T00:26:52.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:26:52.944 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:49.139226+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:26:52.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa63006a0e0 msgr2=0x7fa63006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa63006a0e0 0x7fa63006c5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa634005fd0 tx=0x7fa634005e60 comp rx=0 tx=0).stop 2023-08-31T00:26:52.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 msgr2=0x7fa6440c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:52.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 0x7fa6440c2fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c4d0 tx=0x7fa63800c890 comp rx=0 tx=0).stop 2023-08-31T00:26:52.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 shutdown_connections 2023-08-31T00:26:52.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa63006a0e0 0x7fa63006c5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa6440b1340 0x7fa6441529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa644159450 0x7fa6440c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 --2- 172.21.15.77:0/1934003451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6440c9d40 0x7fa6440c2fb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:52.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 >> 172.21.15.77:0/1934003451 conn(0x7fa6440cbc30 msgr2=0x7fa6440c2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:52.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 shutdown_connections 2023-08-31T00:26:52.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:52.945+0000 7fa649b01700 1 -- 172.21.15.77:0/1934003451 wait complete. 2023-08-31T00:26:52.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:26:52.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:26:53.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.083+0000 7f43e099b700 1 -- 172.21.15.77:0/209684123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 msgr2=0x7f43c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.083+0000 7f43e099b700 1 --2- 172.21.15.77:0/209684123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43c4005210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0afba0 tx=0x7f43c4005880 comp rx=0 tx=0).stop 2023-08-31T00:26:53.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.083+0000 7f43dad9d700 1 -- 172.21.15.77:0/209684123 reap_dead start 2023-08-31T00:26:53.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.084+0000 7f43e099b700 1 -- 172.21.15.77:0/209684123 shutdown_connections 2023-08-31T00:26:53.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.084+0000 7f43e099b700 1 -- 172.21.15.77:0/209684123 >> 172.21.15.77:0/209684123 conn(0x7f43dc06cbf0 msgr2=0x7f43dc06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:53.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.084+0000 7f43e099b700 1 -- 172.21.15.77:0/209684123 shutdown_connections 2023-08-31T00:26:53.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.084+0000 7f43e099b700 1 -- 172.21.15.77:0/209684123 wait complete. 2023-08-31T00:26:53.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.085+0000 7f43e099b700 1 Processor -- start 2023-08-31T00:26:53.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.085+0000 7f43e099b700 1 -- start start 2023-08-31T00:26:53.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43dc0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43dc0c4a20 0x7f43dc14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43dc1e3000 0x7f43dc0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c31d0 con 0x7f43c4004d90 2023-08-31T00:26:53.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c3470 con 0x7f43dc1e3000 2023-08-31T00:26:53.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c3750 con 0x7f43dc0c4a20 2023-08-31T00:26:53.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43dc0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43dc0c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38176/0 (socket says 172.21.15.77:38176) 2023-08-31T00:26:53.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 -- 172.21.15.77:0/3785036045 learned_addr learned my addr 172.21.15.77:0/3785036045 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:53.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43d9d9b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43dc0c4a20 0x7f43dc14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43dad9d700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43dc1e3000 0x7f43dc0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 -- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43dc0c4a20 msgr2=0x7f43dc14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43dc0c4a20 0x7f43dc14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 -- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43dc1e3000 msgr2=0x7f43dc0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43dc1e3000 0x7f43dc0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 -- 172.21.15.77:0/3785036045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0c3a30 con 0x7f43c4004d90 2023-08-31T00:26:53.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43dad9d700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43dc1e3000 0x7f43dc0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:53.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43da59c700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43dc0c4230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43cc011ae0 tx=0x7f43cc011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:53.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00fb80 con 0x7f43c4004d90 2023-08-31T00:26:53.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f43cc00fce0 con 0x7f43c4004d90 2023-08-31T00:26:53.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc0c3d10 con 0x7f43c4004d90 2023-08-31T00:26:53.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc004280 con 0x7f43c4004d90 2023-08-31T00:26:53.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.086+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc1e34b0 con 0x7f43c4004d90 2023-08-31T00:26:53.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.087+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc073c30 con 0x7f43c4004d90 2023-08-31T00:26:53.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.088+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43cc0043e0 con 0x7f43c4004d90 2023-08-31T00:26:53.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.088+0000 7f43caffd700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43bc06a0e0 0x7f43bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.088+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f43cc088ae0 con 0x7f43c4004d90 2023-08-31T00:26:53.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.088+0000 7f43d9d9b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43bc06a0e0 0x7f43bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.088+0000 7f43d9d9b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43bc06a0e0 0x7f43bc06c5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43d00068e0 tx=0x7f43d0006870 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:53.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.093+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43cc0546d0 con 0x7f43c4004d90 2023-08-31T00:26:53.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.284+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43dc0c98e0 con 0x7f43c4004d90 2023-08-31T00:26:53.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.284+0000 7f43caffd700 1 -- 172.21.15.77:0/3785036045 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43cc057cf0 con 0x7f43c4004d90 2023-08-31T00:26:53.285 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:26:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43bc06a0e0 msgr2=0x7f43bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43bc06a0e0 0x7f43bc06c5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43d00068e0 tx=0x7f43d0006870 comp rx=0 tx=0).stop 2023-08-31T00:26:53.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 msgr2=0x7f43dc0c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43dc0c4230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43cc011ae0 tx=0x7f43cc011ea0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 shutdown_connections 2023-08-31T00:26:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43bc06a0e0 0x7f43bc06c5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43dc1e3000 0x7f43dc0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43c4004d90 0x7f43dc0c4230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 --2- 172.21.15.77:0/3785036045 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43dc0c4a20 0x7f43dc14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 >> 172.21.15.77:0/3785036045 conn(0x7f43dc06cbf0 msgr2=0x7f43dc151470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 shutdown_connections 2023-08-31T00:26:53.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.286+0000 7f43e099b700 1 -- 172.21.15.77:0/3785036045 wait complete. 2023-08-31T00:26:53.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:26:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/3131211919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 msgr2=0x7f2bf0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/3131211919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2bf0004850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009be0 tx=0x7f2bf0005880 comp rx=0 tx=0).stop 2023-08-31T00:26:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c09c4e700 1 -- 172.21.15.77:0/3131211919 reap_dead start 2023-08-31T00:26:53.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/3131211919 shutdown_connections 2023-08-31T00:26:53.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/3131211919 >> 172.21.15.77:0/3131211919 conn(0x7f2c0406cbf0 msgr2=0x7f2c0406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:53.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/3131211919 shutdown_connections 2023-08-31T00:26:53.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.421+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/3131211919 wait complete. 2023-08-31T00:26:53.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.422+0000 7f2c0b6b1700 1 Processor -- start 2023-08-31T00:26:53.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.422+0000 7f2c0b6b1700 1 -- start start 2023-08-31T00:26:53.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2c041f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c04154b40 0x7f2c04069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c0406a080 0x7f2c04143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0406a500 con 0x7f2bf0003f80 2023-08-31T00:26:53.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041f5310 con 0x7f2c04154b40 2023-08-31T00:26:53.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041f2230 con 0x7f2c0406a080 2023-08-31T00:26:53.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2c041f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2c041f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38196/0 (socket says 172.21.15.77:38196) 2023-08-31T00:26:53.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 -- 172.21.15.77:0/1396094835 learned_addr learned my addr 172.21.15.77:0/1396094835 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:53.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c08c4c700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c04154b40 0x7f2c04069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c09c4e700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c0406a080 0x7f2c04143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 -- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c0406a080 msgr2=0x7f2c04143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c0406a080 0x7f2c04143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 -- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c04154b40 msgr2=0x7f2c04069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c04154b40 0x7f2c04069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 -- 172.21.15.77:0/1396094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c041f2510 con 0x7f2bf0003f80 2023-08-31T00:26:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0944d700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2c041f57a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c00011b10 tx=0x7f2c00011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000fcc0 con 0x7f2bf0003f80 2023-08-31T00:26:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2c0000fe20 con 0x7f2bf0003f80 2023-08-31T00:26:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c041f4fa0 con 0x7f2bf0003f80 2023-08-31T00:26:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.423+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00004280 con 0x7f2bf0003f80 2023-08-31T00:26:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.424+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c041f5ce0 con 0x7f2bf0003f80 2023-08-31T00:26:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.424+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c041f55f0 con 0x7f2bf0003f80 2023-08-31T00:26:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.425+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c000043e0 con 0x7f2bf0003f80 2023-08-31T00:26:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.425+0000 7f2bf9ffb700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2be806a0e0 0x7f2be806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.425+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c00088ad0 con 0x7f2bf0003f80 2023-08-31T00:26:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.425+0000 7f2c08c4c700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2be806a0e0 0x7f2be806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.426+0000 7f2c08c4c700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2be806a0e0 0x7f2be806c5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000c00 tx=0x7f2bf4004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:53.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.430+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2c00054770 con 0x7f2bf0003f80 2023-08-31T00:26:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.661+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c04073c30 con 0x7f2bf0003f80 2023-08-31T00:26:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.661+0000 7f2bf9ffb700 1 -- 172.21.15.77:0/1396094835 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f2c00057d90 con 0x7f2bf0003f80 2023-08-31T00:26:53.662 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:26:53.663 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-31T00:26:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2be806a0e0 msgr2=0x7f2be806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2be806a0e0 0x7f2be806c5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4000c00 tx=0x7f2bf4004750 comp rx=0 tx=0).stop 2023-08-31T00:26:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 msgr2=0x7f2c041f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2c041f57a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2c00011b10 tx=0x7f2c00011e20 comp rx=0 tx=0).stop 2023-08-31T00:26:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 shutdown_connections 2023-08-31T00:26:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2be806a0e0 0x7f2be806c5a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2c0406a080 0x7f2c04143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf0003f80 0x7f2c041f57a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 --2- 172.21.15.77:0/1396094835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c04154b40 0x7f2c04069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 >> 172.21.15.77:0/1396094835 conn(0x7f2c0406cbf0 msgr2=0x7f2c040cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 shutdown_connections 2023-08-31T00:26:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:53.663+0000 7f2c0b6b1700 1 -- 172.21.15.77:0/1396094835 wait complete. 2023-08-31T00:26:53.667 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2023-08-31T00:26:55.677 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:26:55.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.812+0000 7f6f4d37d700 1 -- 172.21.15.77:0/510531312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f30003a00 msgr2=0x7f6f30003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:55.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.812+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/510531312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f30003a00 0x7f6f30003e20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009be0 tx=0x7f6f30005880 comp rx=0 tx=0).stop 2023-08-31T00:26:55.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.813+0000 7f6f477fe700 1 -- 172.21.15.77:0/510531312 reap_dead start 2023-08-31T00:26:55.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.813+0000 7f6f4d37d700 1 -- 172.21.15.77:0/510531312 shutdown_connections 2023-08-31T00:26:55.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.813+0000 7f6f4d37d700 1 -- 172.21.15.77:0/510531312 >> 172.21.15.77:0/510531312 conn(0x7f6f48071630 msgr2=0x7f6f48071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:55.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.813+0000 7f6f4d37d700 1 -- 172.21.15.77:0/510531312 shutdown_connections 2023-08-31T00:26:55.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.813+0000 7f6f4d37d700 1 -- 172.21.15.77:0/510531312 wait complete. 2023-08-31T00:26:55.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.814+0000 7f6f4d37d700 1 Processor -- start 2023-08-31T00:26:55.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.814+0000 7f6f4d37d700 1 -- start start 2023-08-31T00:26:55.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f4d37d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f30003a00 0x7f6f481538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f4d37d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f480c97f0 0x7f6f480c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f4d37d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 0x7f6f4815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f4d37d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4815a570 con 0x7f6f48159bb0 2023-08-31T00:26:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f4d37d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480cae30 con 0x7f6f30003a00 2023-08-31T00:26:55.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f4d37d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c9d90 con 0x7f6f480c97f0 2023-08-31T00:26:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 0x7f6f4815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 0x7f6f4815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38220/0 (socket says 172.21.15.77:38220) 2023-08-31T00:26:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.815+0000 7f6f477fe700 1 -- 172.21.15.77:0/3637762426 learned_addr learned my addr 172.21.15.77:0/3637762426 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f46ffd700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f30003a00 0x7f6f481538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:55.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f467fc700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f480c97f0 0x7f6f480c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f477fe700 1 -- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f480c97f0 msgr2=0x7f6f480c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f477fe700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f480c97f0 0x7f6f480c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f477fe700 1 -- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f30003a00 msgr2=0x7f6f481538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f477fe700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f30003a00 0x7f6f481538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f477fe700 1 -- 172.21.15.77:0/3637762426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480ca070 con 0x7f6f48159bb0 2023-08-31T00:26:55.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f46ffd700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f30003a00 0x7f6f481538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:26:55.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f467fc700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f480c97f0 0x7f6f480c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:26:55.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f477fe700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 0x7f6f4815a030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f480c4de0 tx=0x7f6f40006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:55.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000f980 con 0x7f6f48159bb0 2023-08-31T00:26:55.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f4000fae0 con 0x7f6f48159bb0 2023-08-31T00:26:55.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f480ca350 con 0x7f6f48159bb0 2023-08-31T00:26:55.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000fed0 con 0x7f6f48159bb0 2023-08-31T00:26:55.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.816+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f480ca910 con 0x7f6f48159bb0 2023-08-31T00:26:55.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.817+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f48073c30 con 0x7f6f48159bb0 2023-08-31T00:26:55.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.817+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f4001d460 con 0x7f6f48159bb0 2023-08-31T00:26:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.818+0000 7f6f2f7fe700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6f3406a0e0 0x7f6f3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.818+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f40088b90 con 0x7f6f48159bb0 2023-08-31T00:26:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.818+0000 7f6f46ffd700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6f3406a0e0 0x7f6f3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:55.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.818+0000 7f6f46ffd700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6f3406a0e0 0x7f6f3406c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009be0 tx=0x7f6f38004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:55.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:55.822+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6f40054630 con 0x7f6f48159bb0 2023-08-31T00:26:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.053+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f480b6930 con 0x7f6f48159bb0 2023-08-31T00:26:56.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.054+0000 7f6f2f7fe700 1 -- 172.21.15.77:0/3637762426 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f6f40057c50 con 0x7f6f48159bb0 2023-08-31T00:26:56.056 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:26:56.056 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-31T00:26:56.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6f3406a0e0 msgr2=0x7f6f3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6f3406a0e0 0x7f6f3406c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009be0 tx=0x7f6f38004750 comp rx=0 tx=0).stop 2023-08-31T00:26:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 msgr2=0x7f6f4815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 0x7f6f4815a030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f480c4de0 tx=0x7f6f40006760 comp rx=0 tx=0).stop 2023-08-31T00:26:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 shutdown_connections 2023-08-31T00:26:56.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6f3406a0e0 0x7f6f3406c5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f48159bb0 0x7f6f4815a030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f30003a00 0x7f6f481538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 --2- 172.21.15.77:0/3637762426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6f480c97f0 0x7f6f480c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 >> 172.21.15.77:0/3637762426 conn(0x7f6f48071630 msgr2=0x7f6f480cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:56.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 shutdown_connections 2023-08-31T00:26:56.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.056+0000 7f6f4d37d700 1 -- 172.21.15.77:0/3637762426 wait complete. 2023-08-31T00:26:56.060 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2023-08-31T00:26:56.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:26:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 -- 172.21.15.77:0/753042967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f936c004850 msgr2=0x7f936c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 --2- 172.21.15.77:0/753042967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f936c004850 0x7f936c004cd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f937c00c310 tx=0x7f936c005880 comp rx=0 tx=0).stop 2023-08-31T00:26:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 -- 172.21.15.77:0/753042967 shutdown_connections 2023-08-31T00:26:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 --2- 172.21.15.77:0/753042967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f936c004850 0x7f936c004cd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 -- 172.21.15.77:0/753042967 >> 172.21.15.77:0/753042967 conn(0x7f9380070270 msgr2=0x7f9380070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 -- 172.21.15.77:0/753042967 shutdown_connections 2023-08-31T00:26:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.191+0000 7f93884ce700 1 -- 172.21.15.77:0/753042967 wait complete. 2023-08-31T00:26:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.193+0000 7f93884ce700 1 Processor -- start 2023-08-31T00:26:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.193+0000 7f93884ce700 1 -- start start 2023-08-31T00:26:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f936c004850 0x7f9380152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9380157860 0x7f9380159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 0x7f93800b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9380156650 con 0x7f9380159560 2023-08-31T00:26:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93800c1380 con 0x7f936c004850 2023-08-31T00:26:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93800c1660 con 0x7f9380157860 2023-08-31T00:26:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 0x7f93800b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 0x7f93800b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38240/0 (socket says 172.21.15.77:38240) 2023-08-31T00:26:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 -- 172.21.15.77:0/371744112 learned_addr learned my addr 172.21.15.77:0/371744112 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9385a69700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9380157860 0x7f9380159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f938626a700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f936c004850 0x7f9380152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 -- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9380157860 msgr2=0x7f9380159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9380157860 0x7f9380159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 -- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f936c004850 msgr2=0x7f9380152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f936c004850 0x7f9380152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 -- 172.21.15.77:0/371744112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800c1940 con 0x7f9380159560 2023-08-31T00:26:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9385a69700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9380157860 0x7f9380159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f938626a700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f936c004850 0x7f9380152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9386a6b700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 0x7f93800b0600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f938006d100 tx=0x7f9378006340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378011840 con 0x7f9380159560 2023-08-31T00:26:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93780119c0 con 0x7f9380159560 2023-08-31T00:26:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93800c1c20 con 0x7f9380159560 2023-08-31T00:26:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378011e10 con 0x7f9380159560 2023-08-31T00:26:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.194+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9380153050 con 0x7f9380159560 2023-08-31T00:26:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.195+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93801f2d80 con 0x7f9380159560 2023-08-31T00:26:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.196+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f937801d460 con 0x7f9380159560 2023-08-31T00:26:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.196+0000 7f9376ffd700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f936406a0e0 0x7f936406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.196+0000 7f938626a700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f936406a0e0 0x7f936406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.196+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93780889a0 con 0x7f9380159560 2023-08-31T00:26:56.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.196+0000 7f938626a700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f936406a0e0 0x7f936406c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9370009c50 tx=0x7f9370009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:56.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.200+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93780544d0 con 0x7f9380159560 2023-08-31T00:26:56.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.393+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93801f2f30 con 0x7f9380159560 2023-08-31T00:26:56.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.394+0000 7f9376ffd700 1 -- 172.21.15.77:0/371744112 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f93801f2f30 con 0x7f9380159560 2023-08-31T00:26:56.396 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:26:56.396 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:49.139226+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:26:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f936406a0e0 msgr2=0x7f936406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f936406a0e0 0x7f936406c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9370009c50 tx=0x7f9370009260 comp rx=0 tx=0).stop 2023-08-31T00:26:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 msgr2=0x7f93800b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 0x7f93800b0600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f938006d100 tx=0x7f9378006340 comp rx=0 tx=0).stop 2023-08-31T00:26:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 shutdown_connections 2023-08-31T00:26:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f936406a0e0 0x7f936406c5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9380159560 0x7f93800b0600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f936c004850 0x7f9380152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.396+0000 7f93884ce700 1 --2- 172.21.15.77:0/371744112 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9380157860 0x7f9380159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.397+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 >> 172.21.15.77:0/371744112 conn(0x7f9380070270 msgr2=0x7f9380157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:56.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.397+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 shutdown_connections 2023-08-31T00:26:56.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.397+0000 7f93884ce700 1 -- 172.21.15.77:0/371744112 wait complete. 2023-08-31T00:26:56.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:26:56.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:26:56.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/2203923935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a10003a30 msgr2=0x7f4a10003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/2203923935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a10003a30 0x7f4a10003e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c001730 tx=0x7f4a10005880 comp rx=0 tx=0).stop 2023-08-31T00:26:56.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a26d9d700 1 -- 172.21.15.77:0/2203923935 reap_dead start 2023-08-31T00:26:56.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/2203923935 shutdown_connections 2023-08-31T00:26:56.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/2203923935 >> 172.21.15.77:0/2203923935 conn(0x7f4a2806cbf0 msgr2=0x7f4a2806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:56.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/2203923935 shutdown_connections 2023-08-31T00:26:56.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.534+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/2203923935 wait complete. 2023-08-31T00:26:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 Processor -- start 2023-08-31T00:26:56.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 -- start start 2023-08-31T00:26:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a10003a30 0x7f4a280b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 0x7f4a280c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4a2815ba00 0x7f4a28155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280c2eb0 con 0x7f4a2815b580 2023-08-31T00:26:56.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28155920 con 0x7f4a10003a30 2023-08-31T00:26:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a2c8cb700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280b1200 con 0x7f4a2815ba00 2023-08-31T00:26:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a25d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 0x7f4a280c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a25d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 0x7f4a280c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38258/0 (socket says 172.21.15.77:38258) 2023-08-31T00:26:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.536+0000 7f4a25d9b700 1 -- 172.21.15.77:0/467182722 learned_addr learned my addr 172.21.15.77:0/467182722 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:56.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a2659c700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a10003a30 0x7f4a280b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a26d9d700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4a2815ba00 0x7f4a28155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a25d9b700 1 -- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4a2815ba00 msgr2=0x7f4a28155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a25d9b700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4a2815ba00 0x7f4a28155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a25d9b700 1 -- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a10003a30 msgr2=0x7f4a280b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a25d9b700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a10003a30 0x7f4a280b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a25d9b700 1 -- 172.21.15.77:0/467182722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28154d10 con 0x7f4a2815b580 2023-08-31T00:26:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a26d9d700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4a2815ba00 0x7f4a28155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:26:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a25d9b700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 0x7f4a280c43d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800fa30 tx=0x7f4a1800fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800dbe0 con 0x7f4a2815b580 2023-08-31T00:26:56.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a1800de30 con 0x7f4a2815b580 2023-08-31T00:26:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a28154ff0 con 0x7f4a2815b580 2023-08-31T00:26:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a180116a0 con 0x7f4a2815b580 2023-08-31T00:26:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.537+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a281555b0 con 0x7f4a2815b580 2023-08-31T00:26:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.538+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2815a1a0 con 0x7f4a2815b580 2023-08-31T00:26:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.538+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a18011800 con 0x7f4a2815b580 2023-08-31T00:26:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.539+0000 7f4a16ffd700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4a0806a0e0 0x7f4a0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.539+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a18088cb0 con 0x7f4a2815b580 2023-08-31T00:26:56.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.539+0000 7f4a2659c700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4a0806a0e0 0x7f4a0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.539+0000 7f4a2659c700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4a0806a0e0 0x7f4a0806c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c000c00 tx=0x7f4a1c001190 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:56.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.543+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4a180547e0 con 0x7f4a2815b580 2023-08-31T00:26:56.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.731+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a28073c30 con 0x7f4a2815b580 2023-08-31T00:26:56.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.731+0000 7f4a16ffd700 1 -- 172.21.15.77:0/467182722 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a18057e00 con 0x7f4a2815b580 2023-08-31T00:26:56.732 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:26:56.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4a0806a0e0 msgr2=0x7f4a0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4a0806a0e0 0x7f4a0806c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c000c00 tx=0x7f4a1c001190 comp rx=0 tx=0).stop 2023-08-31T00:26:56.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 msgr2=0x7f4a280c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 0x7f4a280c43d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800fa30 tx=0x7f4a1800fdf0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 shutdown_connections 2023-08-31T00:26:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4a0806a0e0 0x7f4a0806c5a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4a2815ba00 0x7f4a28155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a10003a30 0x7f4a280b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 --2- 172.21.15.77:0/467182722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a2815b580 0x7f4a280c43d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 >> 172.21.15.77:0/467182722 conn(0x7f4a2806cbf0 msgr2=0x7f4a28159760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:56.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 shutdown_connections 2023-08-31T00:26:56.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.733+0000 7f4a2c8cb700 1 -- 172.21.15.77:0/467182722 wait complete. 2023-08-31T00:26:56.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T00:26:56.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 -- 172.21.15.77:0/458950954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c601580f0 msgr2=0x7f9c600cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 --2- 172.21.15.77:0/458950954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c601580f0 0x7f9c600cc250 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9c600c1750 tx=0x7f9c50009c70 comp rx=0 tx=0).stop 2023-08-31T00:26:56.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 -- 172.21.15.77:0/458950954 shutdown_connections 2023-08-31T00:26:56.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 --2- 172.21.15.77:0/458950954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c60071000 0x7f9c6015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 --2- 172.21.15.77:0/458950954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c601580f0 0x7f9c600cc250 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 --2- 172.21.15.77:0/458950954 >> v2:172.21.15.139:3300/0 conn(0x7f9c6006f130 0x7f9c60070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 -- 172.21.15.77:0/458950954 >> 172.21.15.77:0/458950954 conn(0x7f9c6006cbf0 msgr2=0x7f9c6006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 -- 172.21.15.77:0/458950954 shutdown_connections 2023-08-31T00:26:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.867+0000 7f9c67598700 1 -- 172.21.15.77:0/458950954 wait complete. 2023-08-31T00:26:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.868+0000 7f9c67598700 1 Processor -- start 2023-08-31T00:26:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.868+0000 7f9c67598700 1 -- start start 2023-08-31T00:26:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c6006f130 0x7f9c601ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 0x7f9c600c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601580f0 0x7f9c6014f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600c61b0 con 0x7f9c60071000 2023-08-31T00:26:56.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600c4c20 con 0x7f9c601580f0 2023-08-31T00:26:56.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600c6400 con 0x7f9c6006f130 2023-08-31T00:26:56.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 0x7f9c600c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 0x7f9c600c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38270/0 (socket says 172.21.15.77:38270) 2023-08-31T00:26:56.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 -- 172.21.15.77:0/2027837608 learned_addr learned my addr 172.21.15.77:0/2027837608 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:56.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c65334700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c6006f130 0x7f9c601ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c65b35700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601580f0 0x7f9c6014f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 -- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c6006f130 msgr2=0x7f9c601ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c6006f130 0x7f9c601ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 -- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601580f0 msgr2=0x7f9c6014f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:56.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601580f0 0x7f9c6014f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:56.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 -- 172.21.15.77:0/2027837608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500095f0 con 0x7f9c60071000 2023-08-31T00:26:56.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c65334700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c6006f130 0x7f9c601ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:26:56.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c65b35700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601580f0 0x7f9c6014f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:26:56.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c64b33700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 0x7f9c600c41d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c007b50 tx=0x7f9c5c007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:56.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c011070 con 0x7f9c60071000 2023-08-31T00:26:56.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9c5c00c2e0 con 0x7f9c60071000 2023-08-31T00:26:56.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c600c66e0 con 0x7f9c60071000 2023-08-31T00:26:56.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00e820 con 0x7f9c60071000 2023-08-31T00:26:56.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.869+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c600c1e60 con 0x7f9c60071000 2023-08-31T00:26:56.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.870+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c600c6a30 con 0x7f9c60071000 2023-08-31T00:26:56.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.871+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c5c00e980 con 0x7f9c60071000 2023-08-31T00:26:56.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.871+0000 7f9c55ffb700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9c4406a0e0 0x7f9c4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:56.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.871+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c5c089720 con 0x7f9c60071000 2023-08-31T00:26:56.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.871+0000 7f9c65334700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9c4406a0e0 0x7f9c4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:56.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.871+0000 7f9c65334700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9c4406a0e0 0x7f9c4406c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098e0 tx=0x7f9c50011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:56.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:56.875+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9c5c055300 con 0x7f9c60071000 2023-08-31T00:26:56.944 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:26:56.947 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:26:57.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.072+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c601585b0 con 0x7f9c60071000 2023-08-31T00:26:57.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.072+0000 7f9c55ffb700 1 -- 172.21.15.77:0/2027837608 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c5c058920 con 0x7f9c60071000 2023-08-31T00:26:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:26:57.074 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-08-31T00:26:57.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:26:57.074 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-08-31T00:26:57.074 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-08-31T00:26:57.074 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:26:57.075 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-08-31T00:26:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9c4406a0e0 msgr2=0x7f9c4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9c4406a0e0 0x7f9c4406c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c500098e0 tx=0x7f9c50011040 comp rx=0 tx=0).stop 2023-08-31T00:26:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 msgr2=0x7f9c600c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 0x7f9c600c41d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c007b50 tx=0x7f9c5c007f10 comp rx=0 tx=0).stop 2023-08-31T00:26:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 shutdown_connections 2023-08-31T00:26:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9c4406a0e0 0x7f9c4406c5a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9c6006f130 0x7f9c601ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601580f0 0x7f9c6014f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 --2- 172.21.15.77:0/2027837608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c60071000 0x7f9c600c41d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.074+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 >> 172.21.15.77:0/2027837608 conn(0x7f9c6006cbf0 msgr2=0x7f9c600ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:57.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.075+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 shutdown_connections 2023-08-31T00:26:57.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.075+0000 7f9c67598700 1 -- 172.21.15.77:0/2027837608 wait complete. 2023-08-31T00:26:57.087 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T00:26:57.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-31T00:26:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 -- 172.21.15.77:0/4177078604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e806ddc0 msgr2=0x7f45e8070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 --2- 172.21.15.77:0/4177078604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e806ddc0 0x7f45e8070e30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45e80721b0 tx=0x7f45e000b380 comp rx=0 tx=0).stop 2023-08-31T00:26:57.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 -- 172.21.15.77:0/4177078604 shutdown_connections 2023-08-31T00:26:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 --2- 172.21.15.77:0/4177078604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e806ddc0 0x7f45e8070e30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 --2- 172.21.15.77:0/4177078604 >> v2:172.21.15.139:3300/0 conn(0x7f45e8158270 0x7f45e80708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 -- 172.21.15.77:0/4177078604 >> 172.21.15.77:0/4177078604 conn(0x7f45e80afb80 msgr2=0x7f45e80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 -- 172.21.15.77:0/4177078604 shutdown_connections 2023-08-31T00:26:57.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.213+0000 7f45ef811700 1 -- 172.21.15.77:0/4177078604 wait complete. 2023-08-31T00:26:57.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.215+0000 7f45ef811700 1 Processor -- start 2023-08-31T00:26:57.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.215+0000 7f45ef811700 1 -- start start 2023-08-31T00:26:57.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45e806ddc0 0x7f45e81e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45e8157e90 0x7f45e814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 0x7f45e80b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e81e2650 con 0x7f45e8158270 2023-08-31T00:26:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8159280 con 0x7f45e806ddc0 2023-08-31T00:26:57.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e81e1aa0 con 0x7f45e8157e90 2023-08-31T00:26:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 0x7f45e80b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 0x7f45e80b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38286/0 (socket says 172.21.15.77:38286) 2023-08-31T00:26:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 -- 172.21.15.77:0/782880272 learned_addr learned my addr 172.21.15.77:0/782880272 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:57.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ed5ad700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45e806ddc0 0x7f45e81e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ecdac700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45e8157e90 0x7f45e814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 -- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45e8157e90 msgr2=0x7f45e814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45e8157e90 0x7f45e814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 -- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45e806ddc0 msgr2=0x7f45e81e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:57.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45e806ddc0 0x7f45e81e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 -- 172.21.15.77:0/782880272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0009d00 con 0x7f45e8158270 2023-08-31T00:26:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45eddae700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 0x7f45e80b2ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009fd0 tx=0x7f45e0009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000e040 con 0x7f45e8158270 2023-08-31T00:26:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45e0007be0 con 0x7f45e8158270 2023-08-31T00:26:57.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e81558b0 con 0x7f45e8158270 2023-08-31T00:26:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.216+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004030 con 0x7f45e8158270 2023-08-31T00:26:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.217+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e81e3010 con 0x7f45e8158270 2023-08-31T00:26:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.218+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e81e2790 con 0x7f45e8158270 2023-08-31T00:26:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.218+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45e00041b0 con 0x7f45e8158270 2023-08-31T00:26:57.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.218+0000 7f45ddffb700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f45cc06a0e0 0x7f45cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.218+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f45e0089970 con 0x7f45e8158270 2023-08-31T00:26:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.219+0000 7f45ed5ad700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f45cc06a0e0 0x7f45cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:57.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.219+0000 7f45ed5ad700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f45cc06a0e0 0x7f45cc06c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45e4004f30 tx=0x7f45e4009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:57.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.223+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f45e81e2790 con 0x7f45e8158270 2023-08-31T00:26:57.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:57.413+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f45e81e2790 con 0x7f45e8158270 2023-08-31T00:26:58.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.290+0000 7f45ddffb700 1 -- 172.21.15.77:0/782880272 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45e81e2790 con 0x7f45e8158270 2023-08-31T00:26:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f45cc06a0e0 msgr2=0x7f45cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f45cc06a0e0 0x7f45cc06c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f45e4004f30 tx=0x7f45e4009040 comp rx=0 tx=0).stop 2023-08-31T00:26:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 msgr2=0x7f45e80b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 0x7f45e80b2ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009fd0 tx=0x7f45e0009450 comp rx=0 tx=0).stop 2023-08-31T00:26:58.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 shutdown_connections 2023-08-31T00:26:58.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f45cc06a0e0 0x7f45cc06c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45e8158270 0x7f45e80b2ca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45e806ddc0 0x7f45e81e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 --2- 172.21.15.77:0/782880272 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45e8157e90 0x7f45e814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 >> 172.21.15.77:0/782880272 conn(0x7f45e80afb80 msgr2=0x7f45e8157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 shutdown_connections 2023-08-31T00:26:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.294+0000 7f45ef811700 1 -- 172.21.15.77:0/782880272 wait complete. 2023-08-31T00:26:58.299 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-08-31T00:26:58.311 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T00:26:58.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 -- 172.21.15.77:0/125552593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc15b620 msgr2=0x7f34bc0c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/125552593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc15b620 0x7f34bc0c9b40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34bc06d0d0 tx=0x7f34b0009c50 comp rx=0 tx=0).stop 2023-08-31T00:26:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 -- 172.21.15.77:0/125552593 shutdown_connections 2023-08-31T00:26:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/125552593 >> v2:172.21.15.139:3300/0 conn(0x7f34bc0b01d0 0x7f34bc06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/125552593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc15b620 0x7f34bc0c9b40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 -- 172.21.15.77:0/125552593 >> 172.21.15.77:0/125552593 conn(0x7f34bc0caca0 msgr2=0x7f34bc0cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 -- 172.21.15.77:0/125552593 shutdown_connections 2023-08-31T00:26:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.445+0000 7f34c2b9d700 1 -- 172.21.15.77:0/125552593 wait complete. 2023-08-31T00:26:58.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.446+0000 7f34c2b9d700 1 Processor -- start 2023-08-31T00:26:58.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.446+0000 7f34c2b9d700 1 -- start start 2023-08-31T00:26:58.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c2b9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 0x7f34bc156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:58.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c2b9d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f34bc15b620 0x7f34bc0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:58.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c2b9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34bc15bd10 0x7f34bc0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c2b9d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0c22c0 con 0x7f34bc0b01d0 2023-08-31T00:26:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c2b9d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0c1050 con 0x7f34bc15bd10 2023-08-31T00:26:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c2b9d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0c1fe0 con 0x7f34bc15b620 2023-08-31T00:26:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c0939700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 0x7f34bc156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c0939700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 0x7f34bc156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38296/0 (socket says 172.21.15.77:38296) 2023-08-31T00:26:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.447+0000 7f34c0939700 1 -- 172.21.15.77:0/3572990024 learned_addr learned my addr 172.21.15.77:0/3572990024 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c113a700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34bc15bd10 0x7f34bc0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c0939700 1 -- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f34bc15b620 msgr2=0x7f34bc0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c0939700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f34bc15b620 0x7f34bc0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c0939700 1 -- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34bc15bd10 msgr2=0x7f34bc0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c0939700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34bc15bd10 0x7f34bc0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c0939700 1 -- 172.21.15.77:0/3572990024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0009580 con 0x7f34bc0b01d0 2023-08-31T00:26:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c0939700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 0x7f34bc156760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34b0000c00 tx=0x7f34b0004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b001d070 con 0x7f34bc0b01d0 2023-08-31T00:26:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34b0003680 con 0x7f34bc0b01d0 2023-08-31T00:26:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc0c0a00 con 0x7f34bc0b01d0 2023-08-31T00:26:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0003ab0 con 0x7f34bc0b01d0 2023-08-31T00:26:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.448+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc156ca0 con 0x7f34bc0b01d0 2023-08-31T00:26:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.449+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc073c30 con 0x7f34bc0b01d0 2023-08-31T00:26:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.449+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34b0003c10 con 0x7f34bc0b01d0 2023-08-31T00:26:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.450+0000 7f34b97fa700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f34a006a0e0 0x7f34a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.450+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f34b0089670 con 0x7f34bc0b01d0 2023-08-31T00:26:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.450+0000 7f34bbfff700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f34a006a0e0 0x7f34a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.450+0000 7f34bbfff700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f34a006a0e0 0x7f34a006c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34a8000f60 tx=0x7f34a8007a40 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.454+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f34b00550c0 con 0x7f34bc0b01d0 2023-08-31T00:26:58.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:58.648+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f34bc0afb50 con 0x7f34bc0b01d0 2023-08-31T00:26:59.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.296+0000 7f34b97fa700 1 -- 172.21.15.77:0/3572990024 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f34b00586e0 con 0x7f34bc0b01d0 2023-08-31T00:26:59.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f34a006a0e0 msgr2=0x7f34a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:59.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f34a006a0e0 0x7f34a006c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34a8000f60 tx=0x7f34a8007a40 comp rx=0 tx=0).stop 2023-08-31T00:26:59.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 msgr2=0x7f34bc156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:59.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 0x7f34bc156760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34b0000c00 tx=0x7f34b0004480 comp rx=0 tx=0).stop 2023-08-31T00:26:59.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 shutdown_connections 2023-08-31T00:26:59.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f34a006a0e0 0x7f34a006c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34bc15bd10 0x7f34bc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34bc0b01d0 0x7f34bc156760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 --2- 172.21.15.77:0/3572990024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f34bc15b620 0x7f34bc0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 >> 172.21.15.77:0/3572990024 conn(0x7f34bc0caca0 msgr2=0x7f34bc15a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:59.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 shutdown_connections 2023-08-31T00:26:59.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.301+0000 7f34c2b9d700 1 -- 172.21.15.77:0/3572990024 wait complete. 2023-08-31T00:26:59.313 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-08-31T00:26:59.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T00:26:59.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 -- 172.21.15.77:0/2819704465 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc35406f130 msgr2=0x7fc354070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:59.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/2819704465 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc35406f130 0x7fc354070ac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc3400098c0 tx=0x7fc340009bd0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 -- 172.21.15.77:0/2819704465 shutdown_connections 2023-08-31T00:26:59.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/2819704465 >> v2:172.21.15.139:3300/0 conn(0x7fc3541580f0 0x7fc3540cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/2819704465 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc35406f130 0x7fc354070ac0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 -- 172.21.15.77:0/2819704465 >> 172.21.15.77:0/2819704465 conn(0x7fc35406cbf0 msgr2=0x7fc35406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:26:59.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 -- 172.21.15.77:0/2819704465 shutdown_connections 2023-08-31T00:26:59.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.454+0000 7fc35ac9d700 1 -- 172.21.15.77:0/2819704465 wait complete. 2023-08-31T00:26:59.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.455+0000 7fc35ac9d700 1 Processor -- start 2023-08-31T00:26:59.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.455+0000 7fc35ac9d700 1 -- start start 2023-08-31T00:26:59.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35ac9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc35406f130 0x7fc3541e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35ac9d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc354071000 0x7fc3541530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35ac9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 0x7fc3541f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35ac9d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc354153c10 con 0x7fc3541580f0 2023-08-31T00:26:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35ac9d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540c3650 con 0x7fc35406f130 2023-08-31T00:26:59.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35ac9d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540c3930 con 0x7fc354071000 2023-08-31T00:26:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 0x7fc3541f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 0x7fc3541f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38314/0 (socket says 172.21.15.77:38314) 2023-08-31T00:26:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 -- 172.21.15.77:0/938491082 learned_addr learned my addr 172.21.15.77:0/938491082 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:26:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc358a39700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc35406f130 0x7fc3541e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:59.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc353fff700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc354071000 0x7fc3541530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 -- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc354071000 msgr2=0x7fc3541530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc354071000 0x7fc3541530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 -- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc35406f130 msgr2=0x7fc3541e58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:26:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc35406f130 0x7fc3541e58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:26:59.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.456+0000 7fc35923a700 1 -- 172.21.15.77:0/938491082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348009520 con 0x7fc3541580f0 2023-08-31T00:26:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.457+0000 7fc35923a700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 0x7fc3541f4ed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00cb40 tx=0x7fc34c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.457+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00ab50 con 0x7fc3541580f0 2023-08-31T00:26:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.457+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc34c00ada0 con 0x7fc3541580f0 2023-08-31T00:26:59.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.457+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc340009520 con 0x7fc3541580f0 2023-08-31T00:26:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.457+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c012680 con 0x7fc3541580f0 2023-08-31T00:26:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.457+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3540c3ef0 con 0x7fc3541580f0 2023-08-31T00:26:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.458+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3540c40e0 con 0x7fc3541580f0 2023-08-31T00:26:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.458+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc34c01b400 con 0x7fc3541580f0 2023-08-31T00:26:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.459+0000 7fc3517fa700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc33806a0e0 0x7fc33806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:26:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.459+0000 7fc358a39700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc33806a0e0 0x7fc33806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:26:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.459+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc34c088c70 con 0x7fc3541580f0 2023-08-31T00:26:59.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.459+0000 7fc358a39700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc33806a0e0 0x7fc33806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc348009ce0 tx=0x7fc348009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:26:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.463+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc34c0544a0 con 0x7fc3541580f0 2023-08-31T00:26:59.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:26:59.697+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc3541585b0 con 0x7fc3541580f0 2023-08-31T00:27:00.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.315+0000 7fc3517fa700 1 -- 172.21.15.77:0/938491082 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc34c01f1b0 con 0x7fc3541580f0 2023-08-31T00:27:00.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.319+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc33806a0e0 msgr2=0x7fc33806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.319+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc33806a0e0 0x7fc33806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc348009ce0 tx=0x7fc348009260 comp rx=0 tx=0).stop 2023-08-31T00:27:00.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.319+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 msgr2=0x7fc3541f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.319+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 0x7fc3541f4ed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00cb40 tx=0x7fc34c00cf00 comp rx=0 tx=0).stop 2023-08-31T00:27:00.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 shutdown_connections 2023-08-31T00:27:00.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc33806a0e0 0x7fc33806c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3541580f0 0x7fc3541f4ed0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc35406f130 0x7fc3541e58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 --2- 172.21.15.77:0/938491082 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc354071000 0x7fc3541530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 >> 172.21.15.77:0/938491082 conn(0x7fc35406cbf0 msgr2=0x7fc354154fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:00.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 shutdown_connections 2023-08-31T00:27:00.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.320+0000 7fc35ac9d700 1 -- 172.21.15.77:0/938491082 wait complete. 2023-08-31T00:27:00.332 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2023-08-31T00:27:00.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:00.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.462+0000 7f8f092f8700 1 -- 172.21.15.77:0/3739390253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f040711d0 msgr2=0x7f8f040c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.462+0000 7f8f092f8700 1 --2- 172.21.15.77:0/3739390253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f040711d0 0x7f8f040c96b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f04071d50 tx=0x7f8efc00b380 comp rx=0 tx=0).stop 2023-08-31T00:27:00.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.463+0000 7f8f092f8700 1 -- 172.21.15.77:0/3739390253 shutdown_connections 2023-08-31T00:27:00.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.463+0000 7f8f092f8700 1 --2- 172.21.15.77:0/3739390253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f040711d0 0x7f8f040c96b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.463+0000 7f8f092f8700 1 --2- 172.21.15.77:0/3739390253 >> v2:172.21.15.139:3300/0 conn(0x7f8f041580f0 0x7f8f040cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.463+0000 7f8f092f8700 1 -- 172.21.15.77:0/3739390253 >> 172.21.15.77:0/3739390253 conn(0x7f8f0406cbf0 msgr2=0x7f8f0406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.463+0000 7f8f092f8700 1 -- 172.21.15.77:0/3739390253 shutdown_connections 2023-08-31T00:27:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.463+0000 7f8f092f8700 1 -- 172.21.15.77:0/3739390253 wait complete. 2023-08-31T00:27:00.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.464+0000 7f8f092f8700 1 Processor -- start 2023-08-31T00:27:00.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.464+0000 7f8f092f8700 1 -- start start 2023-08-31T00:27:00.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8f0406f130 0x7f8f041f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f040711d0 0x7f8f040c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 0x7f8f041e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041f1720 con 0x7f8f041580f0 2023-08-31T00:27:00.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f041f4b20 con 0x7f8f040711d0 2023-08-31T00:27:00.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f040c7ea0 con 0x7f8f0406f130 2023-08-31T00:27:00.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 0x7f8f041e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 0x7f8f041e6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38342/0 (socket says 172.21.15.77:38342) 2023-08-31T00:27:00.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 -- 172.21.15.77:0/1330093976 learned_addr learned my addr 172.21.15.77:0/1330093976 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:00.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f02ffd700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8f0406f130 0x7f8f041f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f027fc700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f040711d0 0x7f8f040c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 -- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8f0406f130 msgr2=0x7f8f041f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8f0406f130 0x7f8f041f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 -- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f040711d0 msgr2=0x7f8f040c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f040711d0 0x7f8f040c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 -- 172.21.15.77:0/1330093976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc009d00 con 0x7f8f041580f0 2023-08-31T00:27:00.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f037fe700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 0x7f8f041e6e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8efc012000 tx=0x7f8efc0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:00.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc00e040 con 0x7f8f041580f0 2023-08-31T00:27:00.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8efc01d680 con 0x7f8f041580f0 2023-08-31T00:27:00.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc01dad0 con 0x7f8f041580f0 2023-08-31T00:27:00.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f040c36a0 con 0x7f8f041580f0 2023-08-31T00:27:00.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.465+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f040c2330 con 0x7f8f041580f0 2023-08-31T00:27:00.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.466+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f041f1860 con 0x7f8f041580f0 2023-08-31T00:27:00.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.467+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8efc01dc30 con 0x7f8f041580f0 2023-08-31T00:27:00.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.467+0000 7f8eeb7fe700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8ef006a0e0 0x7f8ef006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.467+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8efc08a420 con 0x7f8f041580f0 2023-08-31T00:27:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.467+0000 7f8f02ffd700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8ef006a0e0 0x7f8ef006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.467+0000 7f8f02ffd700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8ef006a0e0 0x7f8ef006c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f041e7aa0 tx=0x7f8ef800b3c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.472+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8efc055c90 con 0x7f8f041580f0 2023-08-31T00:27:00.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.662+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f040c9b70 con 0x7f8f041580f0 2023-08-31T00:27:00.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.663+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/1330093976 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f8efc0592b0 con 0x7f8f041580f0 2023-08-31T00:27:00.664 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:00.664 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:59.698936+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:00.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8ef006a0e0 msgr2=0x7f8ef006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8ef006a0e0 0x7f8ef006c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f041e7aa0 tx=0x7f8ef800b3c0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 msgr2=0x7f8f041e6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 0x7f8f041e6e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8efc012000 tx=0x7f8efc0097c0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 shutdown_connections 2023-08-31T00:27:00.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8ef006a0e0 0x7f8ef006c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8f0406f130 0x7f8f041f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f041580f0 0x7f8f041e6e30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 --2- 172.21.15.77:0/1330093976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f040711d0 0x7f8f040c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 >> 172.21.15.77:0/1330093976 conn(0x7f8f0406cbf0 msgr2=0x7f8f0415ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:00.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 shutdown_connections 2023-08-31T00:27:00.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.665+0000 7f8f092f8700 1 -- 172.21.15.77:0/1330093976 wait complete. 2023-08-31T00:27:00.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:00.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 -- 172.21.15.77:0/119275327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01981580f0 msgr2=0x7f01980cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 --2- 172.21.15.77:0/119275327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01981580f0 0x7f01980cc250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0188005fd0 tx=0x7f0188009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:00.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 -- 172.21.15.77:0/119275327 shutdown_connections 2023-08-31T00:27:00.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 --2- 172.21.15.77:0/119275327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01981580f0 0x7f01980cc250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 --2- 172.21.15.77:0/119275327 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f019806f130 0x7f0198070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 -- 172.21.15.77:0/119275327 >> 172.21.15.77:0/119275327 conn(0x7f019806cbf0 msgr2=0x7f019806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:00.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 -- 172.21.15.77:0/119275327 shutdown_connections 2023-08-31T00:27:00.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.799+0000 7f019f4d5700 1 -- 172.21.15.77:0/119275327 wait complete. 2023-08-31T00:27:00.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.800+0000 7f019f4d5700 1 Processor -- start 2023-08-31T00:27:00.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.800+0000 7f019f4d5700 1 -- start start 2023-08-31T00:27:00.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019f4d5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f019806f130 0x7f0198153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019f4d5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 0x7f01980c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019f4d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01981580f0 0x7f01980ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019f4d5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980abc20 con 0x7f0198071000 2023-08-31T00:27:00.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019f4d5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980c6df0 con 0x7f01981580f0 2023-08-31T00:27:00.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019f4d5700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980abe50 con 0x7f019806f130 2023-08-31T00:27:00.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019ca70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 0x7f01980c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019ca70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 0x7f01980c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38354/0 (socket says 172.21.15.77:38354) 2023-08-31T00:27:00.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019ca70700 1 -- 172.21.15.77:0/1189003967 learned_addr learned my addr 172.21.15.77:0/1189003967 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:00.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019da72700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01981580f0 0x7f01980ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.801+0000 7f019d271700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f019806f130 0x7f0198153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019ca70700 1 -- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f019806f130 msgr2=0x7f0198153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019ca70700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f019806f130 0x7f0198153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019ca70700 1 -- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01981580f0 msgr2=0x7f01980ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:00.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019ca70700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01981580f0 0x7f01980ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:00.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019ca70700 1 -- 172.21.15.77:0/1189003967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880095f0 con 0x7f0198071000 2023-08-31T00:27:00.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019ca70700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 0x7f01980c5aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f019400c920 tx=0x7f019400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:00.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194007b00 con 0x7f0198071000 2023-08-31T00:27:00.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0194007d50 con 0x7f0198071000 2023-08-31T00:27:00.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01980c6550 con 0x7f0198071000 2023-08-31T00:27:00.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194004a90 con 0x7f0198071000 2023-08-31T00:27:00.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.802+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01980c6b10 con 0x7f0198071000 2023-08-31T00:27:00.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.803+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198073c30 con 0x7f0198071000 2023-08-31T00:27:00.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.803+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0194004bf0 con 0x7f0198071000 2023-08-31T00:27:00.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.803+0000 7f018dffb700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f017c06a0e0 0x7f017c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:00.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.804+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0194088870 con 0x7f0198071000 2023-08-31T00:27:00.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.804+0000 7f019d271700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f017c06a0e0 0x7f017c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:00.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.804+0000 7f019d271700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f017c06a0e0 0x7f017c06c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01880098e0 tx=0x7f0188011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:00.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.808+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0194054060 con 0x7f0198071000 2023-08-31T00:27:00.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.997+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0198153d10 con 0x7f0198071000 2023-08-31T00:27:00.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:00.999+0000 7f018dffb700 1 -- 172.21.15.77:0/1189003967 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16506 (secure 0 0 0) 0x7f0194057680 con 0x7f0198071000 2023-08-31T00:27:01.000 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:01.000 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:26:59.698936+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:01.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f017c06a0e0 msgr2=0x7f017c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:01.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f017c06a0e0 0x7f017c06c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01880098e0 tx=0x7f0188011040 comp rx=0 tx=0).stop 2023-08-31T00:27:01.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 msgr2=0x7f01980c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:01.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 0x7f01980c5aa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f019400c920 tx=0x7f019400cce0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 shutdown_connections 2023-08-31T00:27:01.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f017c06a0e0 0x7f017c06c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f019806f130 0x7f0198153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01981580f0 0x7f01980ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 --2- 172.21.15.77:0/1189003967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0198071000 0x7f01980c5aa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 >> 172.21.15.77:0/1189003967 conn(0x7f019806cbf0 msgr2=0x7f019815a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:01.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 shutdown_connections 2023-08-31T00:27:01.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.001+0000 7f019f4d5700 1 -- 172.21.15.77:0/1189003967 wait complete. 2023-08-31T00:27:01.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T00:27:01.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f8af2e700 1 -- 172.21.15.77:0/4021326179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f74004d90 msgr2=0x7f3f74005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:01.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/4021326179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f74004d90 0x7f3f74005210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00e350 tx=0x7f3f74005880 comp rx=0 tx=0).stop 2023-08-31T00:27:01.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f894cb700 1 -- 172.21.15.77:0/4021326179 reap_dead start 2023-08-31T00:27:01.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f8af2e700 1 -- 172.21.15.77:0/4021326179 shutdown_connections 2023-08-31T00:27:01.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f8af2e700 1 -- 172.21.15.77:0/4021326179 >> 172.21.15.77:0/4021326179 conn(0x7f3f840cf180 msgr2=0x7f3f840cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f8af2e700 1 -- 172.21.15.77:0/4021326179 shutdown_connections 2023-08-31T00:27:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.139+0000 7f3f8af2e700 1 -- 172.21.15.77:0/4021326179 wait complete. 2023-08-31T00:27:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.140+0000 7f3f8af2e700 1 Processor -- start 2023-08-31T00:27:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.140+0000 7f3f8af2e700 1 -- start start 2023-08-31T00:27:01.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f8af2e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f84154c90 0x7f3f8415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f8af2e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 0x7f3f8415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f8af2e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f840a6460 0x7f3f840c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f8af2e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840c62f0 con 0x7f3f840c8a40 2023-08-31T00:27:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f8af2e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840c65d0 con 0x7f3f840a6460 2023-08-31T00:27:01.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f8af2e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840c68b0 con 0x7f3f84154c90 2023-08-31T00:27:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 0x7f3f8415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 0x7f3f8415ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38374/0 (socket says 172.21.15.77:38374) 2023-08-31T00:27:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 -- 172.21.15.77:0/1194306607 learned_addr learned my addr 172.21.15.77:0/1194306607 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:01.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f88cca700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f84154c90 0x7f3f8415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f894cb700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f840a6460 0x7f3f840c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 -- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f84154c90 msgr2=0x7f3f8415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f84154c90 0x7f3f8415b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 -- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f840a6460 msgr2=0x7f3f840c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:01.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f840a6460 0x7f3f840c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f83fff700 1 -- 172.21.15.77:0/1194306607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8415d7a0 con 0x7f3f840c8a40 2023-08-31T00:27:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.141+0000 7f3f894cb700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f840a6460 0x7f3f840c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.142+0000 7f3f83fff700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 0x7f3f8415ba90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000e930 tx=0x7f3f7000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.142+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000cb00 con 0x7f3f840c8a40 2023-08-31T00:27:01.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.142+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f7000cd50 con 0x7f3f840c8a40 2023-08-31T00:27:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.142+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700116c0 con 0x7f3f840c8a40 2023-08-31T00:27:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.142+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f840c6b90 con 0x7f3f840c8a40 2023-08-31T00:27:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.142+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f840c8fb0 con 0x7f3f840c8a40 2023-08-31T00:27:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.143+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84073c30 con 0x7f3f840c8a40 2023-08-31T00:27:01.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.143+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3f70011820 con 0x7f3f840c8a40 2023-08-31T00:27:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.143+0000 7f3f817fa700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f6806a0e0 0x7f3f6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:01.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.144+0000 7f3f88cca700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f6806a0e0 0x7f3f6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.144+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f70088c20 con 0x7f3f840c8a40 2023-08-31T00:27:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.144+0000 7f3f88cca700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f6806a0e0 0x7f3f6806c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009ca0 tx=0x7f3f78009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:01.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.148+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3f70054400 con 0x7f3f840c8a40 2023-08-31T00:27:01.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:01.388+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3f840c6430 con 0x7f3f840c8a40 2023-08-31T00:27:02.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.326+0000 7f3f817fa700 1 -- 172.21.15.77:0/1194306607 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3f840c6430 con 0x7f3f840c8a40 2023-08-31T00:27:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.329+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f6806a0e0 msgr2=0x7f3f6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.329+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f6806a0e0 0x7f3f6806c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009ca0 tx=0x7f3f78009260 comp rx=0 tx=0).stop 2023-08-31T00:27:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.329+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 msgr2=0x7f3f8415ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.329+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 0x7f3f8415ba90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3f7000e930 tx=0x7f3f7000ecf0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.329+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 shutdown_connections 2023-08-31T00:27:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f6806a0e0 0x7f3f6806c5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3f84154c90 0x7f3f8415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f840a6460 0x7f3f840c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 --2- 172.21.15.77:0/1194306607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f840c8a40 0x7f3f8415ba90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 >> 172.21.15.77:0/1194306607 conn(0x7f3f840cf180 msgr2=0x7f3f84157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:02.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 shutdown_connections 2023-08-31T00:27:02.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.330+0000 7f3f8af2e700 1 -- 172.21.15.77:0/1194306607 wait complete. 2023-08-31T00:27:02.345 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T00:27:02.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T00:27:02.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 -- 172.21.15.77:0/4002787558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d806f130 msgr2=0x7fa5d8070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:02.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/4002787558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d806f130 0x7fa5d8070ac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80cb890 tx=0x7fa5d4009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:02.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 -- 172.21.15.77:0/4002787558 shutdown_connections 2023-08-31T00:27:02.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/4002787558 >> v2:172.21.15.139:3300/0 conn(0x7fa5d8071000 0x7fa5d815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/4002787558 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5d81580f0 0x7fa5d80cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/4002787558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d806f130 0x7fa5d8070ac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 -- 172.21.15.77:0/4002787558 >> 172.21.15.77:0/4002787558 conn(0x7fa5d806cbf0 msgr2=0x7fa5d806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:02.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 -- 172.21.15.77:0/4002787558 shutdown_connections 2023-08-31T00:27:02.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.476+0000 7fa5e00c7700 1 -- 172.21.15.77:0/4002787558 wait complete. 2023-08-31T00:27:02.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.477+0000 7fa5e00c7700 1 Processor -- start 2023-08-31T00:27:02.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.477+0000 7fa5e00c7700 1 -- start start 2023-08-31T00:27:02.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5e00c7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5d806f130 0x7fa5d80c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:02.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5e00c7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 0x7fa5d814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:02.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5e00c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5d81580f0 0x7fa5d80c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:02.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5e00c7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d814daa0 con 0x7fa5d8071000 2023-08-31T00:27:02.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5e00c7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d814e470 con 0x7fa5d81580f0 2023-08-31T00:27:02.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5e00c7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d814ce90 con 0x7fa5d806f130 2023-08-31T00:27:02.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5dd662700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 0x7fa5d814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:02.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5dd662700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 0x7fa5d814df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38388/0 (socket says 172.21.15.77:38388) 2023-08-31T00:27:02.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5dd662700 1 -- 172.21.15.77:0/2819852791 learned_addr learned my addr 172.21.15.77:0/2819852791 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:02.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5dde63700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5d806f130 0x7fa5d80c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:02.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.478+0000 7fa5de664700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5d81580f0 0x7fa5d80c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:02.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5dd662700 1 -- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5d806f130 msgr2=0x7fa5d80c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:02.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5dd662700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5d806f130 0x7fa5d80c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5dd662700 1 -- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5d81580f0 msgr2=0x7fa5d80c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:02.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5dd662700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5d81580f0 0x7fa5d80c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:02.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5dd662700 1 -- 172.21.15.77:0/2819852791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40095f0 con 0x7fa5d8071000 2023-08-31T00:27:02.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5de664700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5d81580f0 0x7fa5d80c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:02.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5dd662700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 0x7fa5d814df30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5d806c500 tx=0x7fa5d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:02.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d401d070 con 0x7fa5d8071000 2023-08-31T00:27:02.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa5d4003890 con 0x7fa5d8071000 2023-08-31T00:27:02.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40045f0 con 0x7fa5d8071000 2023-08-31T00:27:02.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d814d170 con 0x7fa5d8071000 2023-08-31T00:27:02.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.479+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d814d730 con 0x7fa5d8071000 2023-08-31T00:27:02.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.480+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d814dc50 con 0x7fa5d8071000 2023-08-31T00:27:02.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.480+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa5d4003ca0 con 0x7fa5d8071000 2023-08-31T00:27:02.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.481+0000 7fa5ce7fc700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa5bc06a0e0 0x7fa5bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:02.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.481+0000 7fa5dde63700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa5bc06a0e0 0x7fa5bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:02.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.481+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5d4089c20 con 0x7fa5d8071000 2023-08-31T00:27:02.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.481+0000 7fa5dde63700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa5bc06a0e0 0x7fa5bc06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8005950 tx=0x7fa5c80058e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:02.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.485+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa5d814dc50 con 0x7fa5d8071000 2023-08-31T00:27:02.690 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-08-31T00:27:02.690+0000 7facb3074700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T00:27:02.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:02.717+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa5d814dc50 con 0x7fa5d8071000 2023-08-31T00:27:03.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.329+0000 7fa5ce7fc700 1 -- 172.21.15.77:0/2819852791 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5d814dc50 con 0x7fa5d8071000 2023-08-31T00:27:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa5bc06a0e0 msgr2=0x7fa5bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa5bc06a0e0 0x7fa5bc06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8005950 tx=0x7fa5c80058e0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 msgr2=0x7fa5d814df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 0x7fa5d814df30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa5d806c500 tx=0x7fa5d40042f0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 shutdown_connections 2023-08-31T00:27:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa5bc06a0e0 0x7fa5bc06c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa5d806f130 0x7fa5d80c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5d81580f0 0x7fa5d80c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 --2- 172.21.15.77:0/2819852791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5d8071000 0x7fa5d814df30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 >> 172.21.15.77:0/2819852791 conn(0x7fa5d806cbf0 msgr2=0x7fa5d80cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:03.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 shutdown_connections 2023-08-31T00:27:03.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.332+0000 7fa5e00c7700 1 -- 172.21.15.77:0/2819852791 wait complete. 2023-08-31T00:27:03.347 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T00:27:03.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:03.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 -- 172.21.15.77:0/2254158741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 msgr2=0x7f6a600cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 --2- 172.21.15.77:0/2254158741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600cc320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a540098c0 tx=0x7f6a54009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 -- 172.21.15.77:0/2254158741 shutdown_connections 2023-08-31T00:27:03.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 --2- 172.21.15.77:0/2254158741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600cc320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 --2- 172.21.15.77:0/2254158741 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a600b04a0 0x7f6a600ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 -- 172.21.15.77:0/2254158741 >> 172.21.15.77:0/2254158741 conn(0x7f6a60071630 msgr2=0x7f6a60071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:03.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 -- 172.21.15.77:0/2254158741 shutdown_connections 2023-08-31T00:27:03.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.474+0000 7f6a65876700 1 -- 172.21.15.77:0/2254158741 wait complete. 2023-08-31T00:27:03.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.475+0000 7f6a65876700 1 Processor -- start 2023-08-31T00:27:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 -- start start 2023-08-31T00:27:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a600b04a0 0x7f6a601f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a600ce7f0 0x7f6a600c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601f15c0 con 0x7f6a6015b3d0 2023-08-31T00:27:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a601e50e0 con 0x7f6a600b04a0 2023-08-31T00:27:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.476+0000 7f6a65876700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60147570 con 0x7f6a600ce7f0 2023-08-31T00:27:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38404/0 (socket says 172.21.15.77:38404) 2023-08-31T00:27:03.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 -- 172.21.15.77:0/560159980 learned_addr learned my addr 172.21.15.77:0/560159980 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5e7fc700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a600ce7f0 0x7f6a600c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5effd700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a600b04a0 0x7f6a601f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 -- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a600ce7f0 msgr2=0x7f6a600c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a600ce7f0 0x7f6a600c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 -- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a600b04a0 msgr2=0x7f6a601f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a600b04a0 0x7f6a601f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 -- 172.21.15.77:0/560159980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54009520 con 0x7f6a6015b3d0 2023-08-31T00:27:03.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a5f7fe700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600c63a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800cbc0 tx=0x7f6a5800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:03.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5800abb0 con 0x7f6a6015b3d0 2023-08-31T00:27:03.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6a5800ae00 con 0x7f6a6015b3d0 2023-08-31T00:27:03.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a60147850 con 0x7f6a6015b3d0 2023-08-31T00:27:03.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58012680 con 0x7f6a6015b3d0 2023-08-31T00:27:03.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.477+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a601e53c0 con 0x7f6a6015b3d0 2023-08-31T00:27:03.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.478+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a60147d70 con 0x7f6a6015b3d0 2023-08-31T00:27:03.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.479+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a5801a3b0 con 0x7f6a6015b3d0 2023-08-31T00:27:03.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.479+0000 7f6a47fff700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a4c06a0e0 0x7f6a4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.479+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a58088c20 con 0x7f6a6015b3d0 2023-08-31T00:27:03.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.479+0000 7f6a5effd700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a4c06a0e0 0x7f6a4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.479+0000 7f6a5effd700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a4c06a0e0 0x7f6a4c06c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000c00 tx=0x7f6a54011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:03.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.483+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a60147d70 con 0x7f6a6015b3d0 2023-08-31T00:27:03.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.714+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a60147d70 con 0x7f6a6015b3d0 2023-08-31T00:27:03.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.715+0000 7f6a47fff700 1 -- 172.21.15.77:0/560159980 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f6a60147d70 con 0x7f6a6015b3d0 2023-08-31T00:27:03.716 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:03.716 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:03.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a4c06a0e0 msgr2=0x7f6a4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a4c06a0e0 0x7f6a4c06c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000c00 tx=0x7f6a54011040 comp rx=0 tx=0).stop 2023-08-31T00:27:03.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 msgr2=0x7f6a600c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600c63a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800cbc0 tx=0x7f6a5800cf80 comp rx=0 tx=0).stop 2023-08-31T00:27:03.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 shutdown_connections 2023-08-31T00:27:03.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a4c06a0e0 0x7f6a4c06c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a6015b3d0 0x7f6a600c63a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a600b04a0 0x7f6a601f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 --2- 172.21.15.77:0/560159980 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a600ce7f0 0x7f6a600c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 >> 172.21.15.77:0/560159980 conn(0x7f6a60071630 msgr2=0x7f6a600b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:03.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 shutdown_connections 2023-08-31T00:27:03.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.717+0000 7f6a65876700 1 -- 172.21.15.77:0/560159980 wait complete. 2023-08-31T00:27:03.720 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:03.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:03.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e766a0700 1 -- 172.21.15.77:0/2081774321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e5c003fb0 msgr2=0x7f7e5c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2081774321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e5c003fb0 0x7f7e5c004850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000c2e0 tx=0x7f7e5c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e74c3d700 1 -- 172.21.15.77:0/2081774321 reap_dead start 2023-08-31T00:27:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e766a0700 1 -- 172.21.15.77:0/2081774321 shutdown_connections 2023-08-31T00:27:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e766a0700 1 -- 172.21.15.77:0/2081774321 >> 172.21.15.77:0/2081774321 conn(0x7f7e700cf180 msgr2=0x7f7e700cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e766a0700 1 -- 172.21.15.77:0/2081774321 shutdown_connections 2023-08-31T00:27:03.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.851+0000 7f7e766a0700 1 -- 172.21.15.77:0/2081774321 wait complete. 2023-08-31T00:27:03.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.852+0000 7f7e766a0700 1 Processor -- start 2023-08-31T00:27:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.852+0000 7f7e766a0700 1 -- start start 2023-08-31T00:27:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e766a0700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e5c003fb0 0x7f7e70151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e766a0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 0x7f7e70153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e766a0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e701531e0 0x7f7e701542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e766a0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700c7cf0 con 0x7f7e70152d60 2023-08-31T00:27:03.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e766a0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700c7fd0 con 0x7f7e701531e0 2023-08-31T00:27:03.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e766a0700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700c82b0 con 0x7f7e5c003fb0 2023-08-31T00:27:03.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 0x7f7e70153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 0x7f7e70153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38422/0 (socket says 172.21.15.77:38422) 2023-08-31T00:27:03.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 -- 172.21.15.77:0/2148553750 learned_addr learned my addr 172.21.15.77:0/2148553750 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:03.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e74c3d700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e701531e0 0x7f7e701542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6ffff700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e5c003fb0 0x7f7e70151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 -- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e5c003fb0 msgr2=0x7f7e70151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e5c003fb0 0x7f7e70151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 -- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e701531e0 msgr2=0x7f7e701542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e701531e0 0x7f7e701542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.853+0000 7f7e6f7fe700 1 -- 172.21.15.77:0/2148553750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700c8590 con 0x7f7e70152d60 2023-08-31T00:27:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.854+0000 7f7e6f7fe700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 0x7f7e70153d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000c8d0 tx=0x7f7e60000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:03.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.854+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600065a0 con 0x7f7e70152d60 2023-08-31T00:27:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.854+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e60003790 con 0x7f7e70152d60 2023-08-31T00:27:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.854+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e700c2ed0 con 0x7f7e70152d60 2023-08-31T00:27:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.854+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60003ba0 con 0x7f7e70152d60 2023-08-31T00:27:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.854+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e700c8ab0 con 0x7f7e70152d60 2023-08-31T00:27:03.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.855+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e700c8900 con 0x7f7e70152d60 2023-08-31T00:27:03.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.855+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e60021070 con 0x7f7e70152d60 2023-08-31T00:27:03.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.855+0000 7f7e6cff9700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7e5006a0e0 0x7f7e5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:03.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.855+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e60089ff0 con 0x7f7e70152d60 2023-08-31T00:27:03.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.856+0000 7f7e6ffff700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7e5006a0e0 0x7f7e5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:03.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.856+0000 7f7e6ffff700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7e5006a0e0 0x7f7e5006c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e58004690 tx=0x7f7e58009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:03.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:03.860+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e60055860 con 0x7f7e70152d60 2023-08-31T00:27:04.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.047+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e700c7e30 con 0x7f7e70152d60 2023-08-31T00:27:04.049 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.049+0000 7f7e6cff9700 1 -- 172.21.15.77:0/2148553750 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f7e700c7e30 con 0x7f7e70152d60 2023-08-31T00:27:04.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:04.051 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:04.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7e5006a0e0 msgr2=0x7f7e5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7e5006a0e0 0x7f7e5006c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e58004690 tx=0x7f7e58009260 comp rx=0 tx=0).stop 2023-08-31T00:27:04.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 msgr2=0x7f7e70153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 0x7f7e70153d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000c8d0 tx=0x7f7e60000ed0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 shutdown_connections 2023-08-31T00:27:04.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7e5006a0e0 0x7f7e5006c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7e5c003fb0 0x7f7e70151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e701531e0 0x7f7e701542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 --2- 172.21.15.77:0/2148553750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e70152d60 0x7f7e70153d60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 >> 172.21.15.77:0/2148553750 conn(0x7f7e700cf180 msgr2=0x7f7e70154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:04.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 shutdown_connections 2023-08-31T00:27:04.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.051+0000 7f7e766a0700 1 -- 172.21.15.77:0/2148553750 wait complete. 2023-08-31T00:27:04.064 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T00:27:04.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:27:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 -- 172.21.15.77:0/1263082465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c15dc10 msgr2=0x7f855c0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 --2- 172.21.15.77:0/1263082465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c15dc10 0x7f855c0c9d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f855c066cd0 tx=0x7f8550009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 -- 172.21.15.77:0/1263082465 shutdown_connections 2023-08-31T00:27:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 --2- 172.21.15.77:0/1263082465 >> v2:172.21.15.139:3300/0 conn(0x7f855c159530 0x7f855c0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 --2- 172.21.15.77:0/1263082465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c15dc10 0x7f855c0c9d10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 -- 172.21.15.77:0/1263082465 >> 172.21.15.77:0/1263082465 conn(0x7f855c0cf180 msgr2=0x7f855c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:04.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 -- 172.21.15.77:0/1263082465 shutdown_connections 2023-08-31T00:27:04.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.186+0000 7f85623ee700 1 -- 172.21.15.77:0/1263082465 wait complete. 2023-08-31T00:27:04.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.187+0000 7f85623ee700 1 Processor -- start 2023-08-31T00:27:04.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.187+0000 7f85623ee700 1 -- start start 2023-08-31T00:27:04.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 0x7f855c1f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f855c159910 0x7f855c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f855c15dc10 0x7f855c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c1f63e0 con 0x7f855c159530 2023-08-31T00:27:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c06ac20 con 0x7f855c15dc10 2023-08-31T00:27:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c06ae70 con 0x7f855c159910 2023-08-31T00:27:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 0x7f855c1f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 0x7f855c1f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38434/0 (socket says 172.21.15.77:38434) 2023-08-31T00:27:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 -- 172.21.15.77:0/3384066667 learned_addr learned my addr 172.21.15.77:0/3384066667 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:04.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855b7fe700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f855c159910 0x7f855c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f856098b700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f855c15dc10 0x7f855c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 -- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f855c159910 msgr2=0x7f855c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f855c159910 0x7f855c06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 -- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f855c15dc10 msgr2=0x7f855c0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f855c15dc10 0x7f855c0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 -- 172.21.15.77:0/3384066667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500095f0 con 0x7f855c159530 2023-08-31T00:27:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855b7fe700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f855c159910 0x7f855c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f856098b700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f855c15dc10 0x7f855c0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f855bfff700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 0x7f855c1f56f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f854c00d950 tx=0x7f854c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:04.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c009b40 con 0x7f855c159530 2023-08-31T00:27:04.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f854c009d90 con 0x7f855c159530 2023-08-31T00:27:04.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c06b1b0 con 0x7f855c159530 2023-08-31T00:27:04.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c0106c0 con 0x7f855c159530 2023-08-31T00:27:04.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.188+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c06b9f0 con 0x7f855c159530 2023-08-31T00:27:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.189+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c073c30 con 0x7f855c159530 2023-08-31T00:27:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.190+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f854c010820 con 0x7f855c159530 2023-08-31T00:27:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.190+0000 7f8558ff9700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f854806a0e0 0x7f854806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.190+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f854c088a70 con 0x7f855c159530 2023-08-31T00:27:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.190+0000 7f855b7fe700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f854806a0e0 0x7f854806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.191+0000 7f855b7fe700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f854806a0e0 0x7f854806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85500098e0 tx=0x7f8550011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:04.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.194+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f854c0542e0 con 0x7f855c159530 2023-08-31T00:27:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.383+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f855c06b5a0 con 0x7f854806a0e0 2023-08-31T00:27:04.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.390+0000 7f8558ff9700 1 -- 172.21.15.77:0/3384066667 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264630 (secure 0 0 0) 0x7f855c06b5a0 con 0x7f854806a0e0 2023-08-31T00:27:04.394 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:04.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.393+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f854806a0e0 msgr2=0x7f854806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.393+0000 7f85623ee700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f854806a0e0 0x7f854806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85500098e0 tx=0x7f8550011040 comp rx=0 tx=0).stop 2023-08-31T00:27:04.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.393+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 msgr2=0x7f855c1f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.393+0000 7f85623ee700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 0x7f855c1f56f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f854c00d950 tx=0x7f854c00dd10 comp rx=0 tx=0).stop 2023-08-31T00:27:04.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.393+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 shutdown_connections 2023-08-31T00:27:04.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f854806a0e0 0x7f854806c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f855c15dc10 0x7f855c0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f855c159530 0x7f855c1f56f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 --2- 172.21.15.77:0/3384066667 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f855c159910 0x7f855c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 >> 172.21.15.77:0/3384066667 conn(0x7f855c0cf180 msgr2=0x7f855c154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 shutdown_connections 2023-08-31T00:27:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.394+0000 7f85623ee700 1 -- 172.21.15.77:0/3384066667 wait complete. 2023-08-31T00:27:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:27:04.406 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-31T00:27:04.117266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218768,"kb_used_data":2596,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755952,"statfs":{"total":773094113280,"available":772870094848,"internally_reserved":0,"allocated":2658304,"data_stored":1657452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.828142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318384+0000","last_change":"2023-08-31T00:27:00.316606+0000","last_active":"2023-08-31T00:27:00.318384+0000","last_peered":"2023-08-31T00:27:00.318384+0000","last_clean":"2023-08-31T00:27:00.318384+0000","last_became_active":"2023-08-31T00:27:00.316335+0000","last_became_peered":"2023-08-31T00:27:00.316335+0000","last_unstale":"2023-08-31T00:27:00.318384+0000","last_undegraded":"2023-08-31T00:27:00.318384+0000","last_fullsized":"2023-08-31T00:27:00.318384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323653+0000","last_change":"2023-08-31T00:27:00.319751+0000","last_active":"2023-08-31T00:27:00.323653+0000","last_peered":"2023-08-31T00:27:00.323653+0000","last_clean":"2023-08-31T00:27:00.323653+0000","last_became_active":"2023-08-31T00:27:00.319480+0000","last_became_peered":"2023-08-31T00:27:00.319480+0000","last_unstale":"2023-08-31T00:27:00.323653+0000","last_undegraded":"2023-08-31T00:27:00.323653+0000","last_fullsized":"2023-08-31T00:27:00.323653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323058+0000","last_change":"2023-08-31T00:27:00.314460+0000","last_active":"2023-08-31T00:27:00.323058+0000","last_peered":"2023-08-31T00:27:00.323058+0000","last_clean":"2023-08-31T00:27:00.323058+0000","last_became_active":"2023-08-31T00:27:00.314165+0000","last_became_peered":"2023-08-31T00:27:00.314165+0000","last_unstale":"2023-08-31T00:27:00.323058+0000","last_undegraded":"2023-08-31T00:27:00.323058+0000","last_fullsized":"2023-08-31T00:27:00.323058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.335665+0000","last_change":"2023-08-31T00:27:00.330366+0000","last_active":"2023-08-31T00:27:00.335665+0000","last_peered":"2023-08-31T00:27:00.335665+0000","last_clean":"2023-08-31T00:27:00.335665+0000","last_became_active":"2023-08-31T00:27:00.330034+0000","last_became_peered":"2023-08-31T00:27:00.330034+0000","last_unstale":"2023-08-31T00:27:00.335665+0000","last_undegraded":"2023-08-31T00:27:00.335665+0000","last_fullsized":"2023-08-31T00:27:00.335665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318448+0000","last_change":"2023-08-31T00:27:00.315980+0000","last_active":"2023-08-31T00:27:00.318448+0000","last_peered":"2023-08-31T00:27:00.318448+0000","last_clean":"2023-08-31T00:27:00.318448+0000","last_became_active":"2023-08-31T00:27:00.315408+0000","last_became_peered":"2023-08-31T00:27:00.315408+0000","last_unstale":"2023-08-31T00:27:00.318448+0000","last_undegraded":"2023-08-31T00:27:00.318448+0000","last_fullsized":"2023-08-31T00:27:00.318448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330461+0000","last_change":"2023-08-31T00:27:00.327757+0000","last_active":"2023-08-31T00:27:00.330461+0000","last_peered":"2023-08-31T00:27:00.330461+0000","last_clean":"2023-08-31T00:27:00.330461+0000","last_became_active":"2023-08-31T00:27:00.327504+0000","last_became_peered":"2023-08-31T00:27:00.327504+0000","last_unstale":"2023-08-31T00:27:00.330461+0000","last_undegraded":"2023-08-31T00:27:00.330461+0000","last_fullsized":"2023-08-31T00:27:00.330461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.324716+0000","last_change":"2023-08-31T00:27:00.319958+0000","last_active":"2023-08-31T00:27:00.324716+0000","last_peered":"2023-08-31T00:27:00.324716+0000","last_clean":"2023-08-31T00:27:00.324716+0000","last_became_active":"2023-08-31T00:27:00.319594+0000","last_became_peered":"2023-08-31T00:27:00.319594+0000","last_unstale":"2023-08-31T00:27:00.324716+0000","last_undegraded":"2023-08-31T00:27:00.324716+0000","last_fullsized":"2023-08-31T00:27:00.324716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334968+0000","last_change":"2023-08-31T00:27:00.327585+0000","last_active":"2023-08-31T00:27:00.334968+0000","last_peered":"2023-08-31T00:27:00.334968+0000","last_clean":"2023-08-31T00:27:00.334968+0000","last_became_active":"2023-08-31T00:27:00.324961+0000","last_became_peered":"2023-08-31T00:27:00.324961+0000","last_unstale":"2023-08-31T00:27:00.334968+0000","last_undegraded":"2023-08-31T00:27:00.334968+0000","last_fullsized":"2023-08-31T00:27:00.334968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326546+0000","last_change":"2023-08-31T00:27:00.325501+0000","last_active":"2023-08-31T00:27:00.326546+0000","last_peered":"2023-08-31T00:27:00.326546+0000","last_clean":"2023-08-31T00:27:00.326546+0000","last_became_active":"2023-08-31T00:27:00.325229+0000","last_became_peered":"2023-08-31T00:27:00.325229+0000","last_unstale":"2023-08-31T00:27:00.326546+0000","last_undegraded":"2023-08-31T00:27:00.326546+0000","last_fullsized":"2023-08-31T00:27:00.326546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328627+0000","last_change":"2023-08-31T00:27:00.324789+0000","last_active":"2023-08-31T00:27:00.328627+0000","last_peered":"2023-08-31T00:27:00.328627+0000","last_clean":"2023-08-31T00:27:00.328627+0000","last_became_active":"2023-08-31T00:27:00.324505+0000","last_became_peered":"2023-08-31T00:27:00.324505+0000","last_unstale":"2023-08-31T00:27:00.328627+0000","last_undegraded":"2023-08-31T00:27:00.328627+0000","last_fullsized":"2023-08-31T00:27:00.328627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328591+0000","last_change":"2023-08-31T00:27:00.324716+0000","last_active":"2023-08-31T00:27:00.328591+0000","last_peered":"2023-08-31T00:27:00.328591+0000","last_clean":"2023-08-31T00:27:00.328591+0000","last_became_active":"2023-08-31T00:27:00.324443+0000","last_became_peered":"2023-08-31T00:27:00.324443+0000","last_unstale":"2023-08-31T00:27:00.328591+0000","last_undegraded":"2023-08-31T00:27:00.328591+0000","last_fullsized":"2023-08-31T00:27:00.328591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320205+0000","last_change":"2023-08-31T00:27:00.312173+0000","last_active":"2023-08-31T00:27:00.320205+0000","last_peered":"2023-08-31T00:27:00.320205+0000","last_clean":"2023-08-31T00:27:00.320205+0000","last_became_active":"2023-08-31T00:27:00.311885+0000","last_became_peered":"2023-08-31T00:27:00.311885+0000","last_unstale":"2023-08-31T00:27:00.320205+0000","last_undegraded":"2023-08-31T00:27:00.320205+0000","last_fullsized":"2023-08-31T00:27:00.320205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:47.503739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334542+0000","last_change":"2023-08-31T00:27:00.323165+0000","last_active":"2023-08-31T00:27:00.334542+0000","last_peered":"2023-08-31T00:27:00.334542+0000","last_clean":"2023-08-31T00:27:00.334542+0000","last_became_active":"2023-08-31T00:27:00.322854+0000","last_became_peered":"2023-08-31T00:27:00.322854+0000","last_unstale":"2023-08-31T00:27:00.334542+0000","last_undegraded":"2023-08-31T00:27:00.334542+0000","last_fullsized":"2023-08-31T00:27:00.334542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.322228+0000","last_change":"2023-08-31T00:27:00.312986+0000","last_active":"2023-08-31T00:27:00.322228+0000","last_peered":"2023-08-31T00:27:00.322228+0000","last_clean":"2023-08-31T00:27:00.322228+0000","last_became_active":"2023-08-31T00:27:00.312500+0000","last_became_peered":"2023-08-31T00:27:00.312500+0000","last_unstale":"2023-08-31T00:27:00.322228+0000","last_undegraded":"2023-08-31T00:27:00.322228+0000","last_fullsized":"2023-08-31T00:27:00.322228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317911+0000","last_change":"2023-08-31T00:27:00.314835+0000","last_active":"2023-08-31T00:27:00.317911+0000","last_peered":"2023-08-31T00:27:00.317911+0000","last_clean":"2023-08-31T00:27:00.317911+0000","last_became_active":"2023-08-31T00:27:00.314578+0000","last_became_peered":"2023-08-31T00:27:00.314578+0000","last_unstale":"2023-08-31T00:27:00.317911+0000","last_undegraded":"2023-08-31T00:27:00.317911+0000","last_fullsized":"2023-08-31T00:27:00.317911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330395+0000","last_change":"2023-08-31T00:27:00.327680+0000","last_active":"2023-08-31T00:27:00.330395+0000","last_peered":"2023-08-31T00:27:00.330395+0000","last_clean":"2023-08-31T00:27:00.330395+0000","last_became_active":"2023-08-31T00:27:00.327418+0000","last_became_peered":"2023-08-31T00:27:00.327418+0000","last_unstale":"2023-08-31T00:27:00.330395+0000","last_undegraded":"2023-08-31T00:27:00.330395+0000","last_fullsized":"2023-08-31T00:27:00.330395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330383+0000","last_change":"2023-08-31T00:27:00.327254+0000","last_active":"2023-08-31T00:27:00.330383+0000","last_peered":"2023-08-31T00:27:00.330383+0000","last_clean":"2023-08-31T00:27:00.330383+0000","last_became_active":"2023-08-31T00:27:00.326713+0000","last_became_peered":"2023-08-31T00:27:00.326713+0000","last_unstale":"2023-08-31T00:27:00.330383+0000","last_undegraded":"2023-08-31T00:27:00.330383+0000","last_fullsized":"2023-08-31T00:27:00.330383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.308891+0000","last_change":"2023-08-31T00:27:00.303375+0000","last_active":"2023-08-31T00:27:00.308891+0000","last_peered":"2023-08-31T00:27:00.308891+0000","last_clean":"2023-08-31T00:27:00.308891+0000","last_became_active":"2023-08-31T00:27:00.303086+0000","last_became_peered":"2023-08-31T00:27:00.303086+0000","last_unstale":"2023-08-31T00:27:00.308891+0000","last_undegraded":"2023-08-31T00:27:00.308891+0000","last_fullsized":"2023-08-31T00:27:00.308891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.316748+0000","last_change":"2023-08-31T00:27:00.315115+0000","last_active":"2023-08-31T00:27:00.316748+0000","last_peered":"2023-08-31T00:27:00.316748+0000","last_clean":"2023-08-31T00:27:00.316748+0000","last_became_active":"2023-08-31T00:27:00.314835+0000","last_became_peered":"2023-08-31T00:27:00.314835+0000","last_unstale":"2023-08-31T00:27:00.316748+0000","last_undegraded":"2023-08-31T00:27:00.316748+0000","last_fullsized":"2023-08-31T00:27:00.316748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338760+0000","last_change":"2023-08-31T00:26:59.319947+0000","last_active":"2023-08-31T00:27:00.338760+0000","last_peered":"2023-08-31T00:27:00.338760+0000","last_clean":"2023-08-31T00:27:00.338760+0000","last_became_active":"2023-08-31T00:26:59.319620+0000","last_became_peered":"2023-08-31T00:26:59.319620+0000","last_unstale":"2023-08-31T00:27:00.338760+0000","last_undegraded":"2023-08-31T00:27:00.338760+0000","last_fullsized":"2023-08-31T00:27:00.338760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.324819+0000","last_change":"2023-08-31T00:27:00.318524+0000","last_active":"2023-08-31T00:27:00.324819+0000","last_peered":"2023-08-31T00:27:00.324819+0000","last_clean":"2023-08-31T00:27:00.324819+0000","last_became_active":"2023-08-31T00:27:00.318265+0000","last_became_peered":"2023-08-31T00:27:00.318265+0000","last_unstale":"2023-08-31T00:27:00.324819+0000","last_undegraded":"2023-08-31T00:27:00.324819+0000","last_fullsized":"2023-08-31T00:27:00.324819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334577+0000","last_change":"2023-08-31T00:26:59.307239+0000","last_active":"2023-08-31T00:27:00.334577+0000","last_peered":"2023-08-31T00:27:00.334577+0000","last_clean":"2023-08-31T00:27:00.334577+0000","last_became_active":"2023-08-31T00:26:59.306693+0000","last_became_peered":"2023-08-31T00:26:59.306693+0000","last_unstale":"2023-08-31T00:27:00.334577+0000","last_undegraded":"2023-08-31T00:27:00.334577+0000","last_fullsized":"2023-08-31T00:27:00.334577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326807+0000","last_change":"2023-08-31T00:27:00.324786+0000","last_active":"2023-08-31T00:27:00.326807+0000","last_peered":"2023-08-31T00:27:00.326807+0000","last_clean":"2023-08-31T00:27:00.326807+0000","last_became_active":"2023-08-31T00:27:00.324524+0000","last_became_peered":"2023-08-31T00:27:00.324524+0000","last_unstale":"2023-08-31T00:27:00.326807+0000","last_undegraded":"2023-08-31T00:27:00.326807+0000","last_fullsized":"2023-08-31T00:27:00.326807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328503+0000","last_change":"2023-08-31T00:26:59.326328+0000","last_active":"2023-08-31T00:27:00.328503+0000","last_peered":"2023-08-31T00:27:00.328503+0000","last_clean":"2023-08-31T00:27:00.328503+0000","last_became_active":"2023-08-31T00:26:59.326028+0000","last_became_peered":"2023-08-31T00:26:59.326028+0000","last_unstale":"2023-08-31T00:27:00.328503+0000","last_undegraded":"2023-08-31T00:27:00.328503+0000","last_fullsized":"2023-08-31T00:27:00.328503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326606+0000","last_change":"2023-08-31T00:27:00.321637+0000","last_active":"2023-08-31T00:27:00.326606+0000","last_peered":"2023-08-31T00:27:00.326606+0000","last_clean":"2023-08-31T00:27:00.326606+0000","last_became_active":"2023-08-31T00:27:00.321377+0000","last_became_peered":"2023-08-31T00:27:00.321377+0000","last_unstale":"2023-08-31T00:27:00.326606+0000","last_undegraded":"2023-08-31T00:27:00.326606+0000","last_fullsized":"2023-08-31T00:27:00.326606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327798+0000","last_change":"2023-08-31T00:26:59.326471+0000","last_active":"2023-08-31T00:27:00.327798+0000","last_peered":"2023-08-31T00:27:00.327798+0000","last_clean":"2023-08-31T00:27:00.327798+0000","last_became_active":"2023-08-31T00:26:59.326163+0000","last_became_peered":"2023-08-31T00:26:59.326163+0000","last_unstale":"2023-08-31T00:27:00.327798+0000","last_undegraded":"2023-08-31T00:27:00.327798+0000","last_fullsized":"2023-08-31T00:27:00.327798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327047+0000","last_change":"2023-08-31T00:27:00.322301+0000","last_active":"2023-08-31T00:27:00.327047+0000","last_peered":"2023-08-31T00:27:00.327047+0000","last_clean":"2023-08-31T00:27:00.327047+0000","last_became_active":"2023-08-31T00:27:00.321299+0000","last_became_peered":"2023-08-31T00:27:00.321299+0000","last_unstale":"2023-08-31T00:27:00.327047+0000","last_undegraded":"2023-08-31T00:27:00.327047+0000","last_fullsized":"2023-08-31T00:27:00.327047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334465+0000","last_change":"2023-08-31T00:26:59.316902+0000","last_active":"2023-08-31T00:27:00.334465+0000","last_peered":"2023-08-31T00:27:00.334465+0000","last_clean":"2023-08-31T00:27:00.334465+0000","last_became_active":"2023-08-31T00:26:59.316643+0000","last_became_peered":"2023-08-31T00:26:59.316643+0000","last_unstale":"2023-08-31T00:27:00.334465+0000","last_undegraded":"2023-08-31T00:27:00.334465+0000","last_fullsized":"2023-08-31T00:27:00.334465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:42.963922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320262+0000","last_change":"2023-08-31T00:27:00.316602+0000","last_active":"2023-08-31T00:27:00.320262+0000","last_peered":"2023-08-31T00:27:00.320262+0000","last_clean":"2023-08-31T00:27:00.320262+0000","last_became_active":"2023-08-31T00:27:00.316285+0000","last_became_peered":"2023-08-31T00:27:00.316285+0000","last_unstale":"2023-08-31T00:27:00.320262+0000","last_undegraded":"2023-08-31T00:27:00.320262+0000","last_fullsized":"2023-08-31T00:27:00.320262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:57:49.440198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329504+0000","last_change":"2023-08-31T00:26:59.314263+0000","last_active":"2023-08-31T00:27:00.329504+0000","last_peered":"2023-08-31T00:27:00.329504+0000","last_clean":"2023-08-31T00:27:00.329504+0000","last_became_active":"2023-08-31T00:26:59.314015+0000","last_became_peered":"2023-08-31T00:26:59.314015+0000","last_unstale":"2023-08-31T00:27:00.329504+0000","last_undegraded":"2023-08-31T00:27:00.329504+0000","last_fullsized":"2023-08-31T00:27:00.329504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323792+0000","last_change":"2023-08-31T00:27:00.315878+0000","last_active":"2023-08-31T00:27:00.323792+0000","last_peered":"2023-08-31T00:27:00.323792+0000","last_clean":"2023-08-31T00:27:00.323792+0000","last_became_active":"2023-08-31T00:27:00.315491+0000","last_became_peered":"2023-08-31T00:27:00.315491+0000","last_unstale":"2023-08-31T00:27:00.323792+0000","last_undegraded":"2023-08-31T00:27:00.323792+0000","last_fullsized":"2023-08-31T00:27:00.323792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311091+0000","last_change":"2023-08-31T00:26:59.313625+0000","last_active":"2023-08-31T00:27:00.311091+0000","last_peered":"2023-08-31T00:27:00.311091+0000","last_clean":"2023-08-31T00:27:00.311091+0000","last_became_active":"2023-08-31T00:26:59.313352+0000","last_became_peered":"2023-08-31T00:26:59.313352+0000","last_unstale":"2023-08-31T00:27:00.311091+0000","last_undegraded":"2023-08-31T00:27:00.311091+0000","last_fullsized":"2023-08-31T00:27:00.311091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334988+0000","last_change":"2023-08-31T00:27:00.328716+0000","last_active":"2023-08-31T00:27:00.334988+0000","last_peered":"2023-08-31T00:27:00.334988+0000","last_clean":"2023-08-31T00:27:00.334988+0000","last_became_active":"2023-08-31T00:27:00.328462+0000","last_became_peered":"2023-08-31T00:27:00.328462+0000","last_unstale":"2023-08-31T00:27:00.334988+0000","last_undegraded":"2023-08-31T00:27:00.334988+0000","last_fullsized":"2023-08-31T00:27:00.334988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317404+0000","last_change":"2023-08-31T00:26:59.318075+0000","last_active":"2023-08-31T00:27:00.317404+0000","last_peered":"2023-08-31T00:27:00.317404+0000","last_clean":"2023-08-31T00:27:00.317404+0000","last_became_active":"2023-08-31T00:26:59.314966+0000","last_became_peered":"2023-08-31T00:26:59.314966+0000","last_unstale":"2023-08-31T00:27:00.317404+0000","last_undegraded":"2023-08-31T00:27:00.317404+0000","last_fullsized":"2023-08-31T00:27:00.317404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327631+0000","last_change":"2023-08-31T00:27:00.322612+0000","last_active":"2023-08-31T00:27:00.327631+0000","last_peered":"2023-08-31T00:27:00.327631+0000","last_clean":"2023-08-31T00:27:00.327631+0000","last_became_active":"2023-08-31T00:27:00.322332+0000","last_became_peered":"2023-08-31T00:27:00.322332+0000","last_unstale":"2023-08-31T00:27:00.327631+0000","last_undegraded":"2023-08-31T00:27:00.327631+0000","last_fullsized":"2023-08-31T00:27:00.327631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300853+0000","last_change":"2023-08-31T00:26:59.317148+0000","last_active":"2023-08-31T00:27:00.300853+0000","last_peered":"2023-08-31T00:27:00.300853+0000","last_clean":"2023-08-31T00:27:00.300853+0000","last_became_active":"2023-08-31T00:26:59.316679+0000","last_became_peered":"2023-08-31T00:26:59.316679+0000","last_unstale":"2023-08-31T00:27:00.300853+0000","last_undegraded":"2023-08-31T00:27:00.300853+0000","last_fullsized":"2023-08-31T00:27:00.300853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330418+0000","last_change":"2023-08-31T00:27:00.327124+0000","last_active":"2023-08-31T00:27:00.330418+0000","last_peered":"2023-08-31T00:27:00.330418+0000","last_clean":"2023-08-31T00:27:00.330418+0000","last_became_active":"2023-08-31T00:27:00.326440+0000","last_became_peered":"2023-08-31T00:27:00.326440+0000","last_unstale":"2023-08-31T00:27:00.330418+0000","last_undegraded":"2023-08-31T00:27:00.330418+0000","last_fullsized":"2023-08-31T00:27:00.330418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317629+0000","last_change":"2023-08-31T00:26:59.319209+0000","last_active":"2023-08-31T00:27:00.317629+0000","last_peered":"2023-08-31T00:27:00.317629+0000","last_clean":"2023-08-31T00:27:00.317629+0000","last_became_active":"2023-08-31T00:26:59.318940+0000","last_became_peered":"2023-08-31T00:26:59.318940+0000","last_unstale":"2023-08-31T00:27:00.317629+0000","last_undegraded":"2023-08-31T00:27:00.317629+0000","last_fullsized":"2023-08-31T00:27:00.317629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:14.443886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326783+0000","last_change":"2023-08-31T00:27:00.321858+0000","last_active":"2023-08-31T00:27:00.326783+0000","last_peered":"2023-08-31T00:27:00.326783+0000","last_clean":"2023-08-31T00:27:00.326783+0000","last_became_active":"2023-08-31T00:27:00.321595+0000","last_became_peered":"2023-08-31T00:27:00.321595+0000","last_unstale":"2023-08-31T00:27:00.326783+0000","last_undegraded":"2023-08-31T00:27:00.326783+0000","last_fullsized":"2023-08-31T00:27:00.326783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.331080+0000","last_change":"2023-08-31T00:26:59.317069+0000","last_active":"2023-08-31T00:27:00.331080+0000","last_peered":"2023-08-31T00:27:00.331080+0000","last_clean":"2023-08-31T00:27:00.331080+0000","last_became_active":"2023-08-31T00:26:59.316783+0000","last_became_peered":"2023-08-31T00:26:59.316783+0000","last_unstale":"2023-08-31T00:27:00.331080+0000","last_undegraded":"2023-08-31T00:27:00.331080+0000","last_fullsized":"2023-08-31T00:27:00.331080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:12.495239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320422+0000","last_change":"2023-08-31T00:27:00.317789+0000","last_active":"2023-08-31T00:27:00.320422+0000","last_peered":"2023-08-31T00:27:00.320422+0000","last_clean":"2023-08-31T00:27:00.320422+0000","last_became_active":"2023-08-31T00:27:00.317275+0000","last_became_peered":"2023-08-31T00:27:00.317275+0000","last_unstale":"2023-08-31T00:27:00.320422+0000","last_undegraded":"2023-08-31T00:27:00.320422+0000","last_fullsized":"2023-08-31T00:27:00.320422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:09:07.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338624+0000","last_change":"2023-08-31T00:26:59.310802+0000","last_active":"2023-08-31T00:27:00.338624+0000","last_peered":"2023-08-31T00:27:00.338624+0000","last_clean":"2023-08-31T00:27:00.338624+0000","last_became_active":"2023-08-31T00:26:59.310150+0000","last_became_peered":"2023-08-31T00:26:59.310150+0000","last_unstale":"2023-08-31T00:27:00.338624+0000","last_undegraded":"2023-08-31T00:27:00.338624+0000","last_fullsized":"2023-08-31T00:27:00.338624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326587+0000","last_change":"2023-08-31T00:27:00.324514+0000","last_active":"2023-08-31T00:27:00.326587+0000","last_peered":"2023-08-31T00:27:00.326587+0000","last_clean":"2023-08-31T00:27:00.326587+0000","last_became_active":"2023-08-31T00:27:00.324137+0000","last_became_peered":"2023-08-31T00:27:00.324137+0000","last_unstale":"2023-08-31T00:27:00.326587+0000","last_undegraded":"2023-08-31T00:27:00.326587+0000","last_fullsized":"2023-08-31T00:27:00.326587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.333647+0000","last_change":"2023-08-31T00:26:59.308265+0000","last_active":"2023-08-31T00:27:00.333647+0000","last_peered":"2023-08-31T00:27:00.333647+0000","last_clean":"2023-08-31T00:27:00.333647+0000","last_became_active":"2023-08-31T00:26:59.307956+0000","last_became_peered":"2023-08-31T00:26:59.307956+0000","last_unstale":"2023-08-31T00:27:00.333647+0000","last_undegraded":"2023-08-31T00:27:00.333647+0000","last_fullsized":"2023-08-31T00:27:00.333647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323516+0000","last_change":"2023-08-31T00:27:00.314782+0000","last_active":"2023-08-31T00:27:00.323516+0000","last_peered":"2023-08-31T00:27:00.323516+0000","last_clean":"2023-08-31T00:27:00.323516+0000","last_became_active":"2023-08-31T00:27:00.314505+0000","last_became_peered":"2023-08-31T00:27:00.314505+0000","last_unstale":"2023-08-31T00:27:00.323516+0000","last_undegraded":"2023-08-31T00:27:00.323516+0000","last_fullsized":"2023-08-31T00:27:00.323516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318391+0000","last_change":"2023-08-31T00:26:59.320415+0000","last_active":"2023-08-31T00:27:00.318391+0000","last_peered":"2023-08-31T00:27:00.318391+0000","last_clean":"2023-08-31T00:27:00.318391+0000","last_became_active":"2023-08-31T00:26:59.319939+0000","last_became_peered":"2023-08-31T00:26:59.319939+0000","last_unstale":"2023-08-31T00:27:00.318391+0000","last_undegraded":"2023-08-31T00:27:00.318391+0000","last_fullsized":"2023-08-31T00:27:00.318391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:08.276952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318468+0000","last_change":"2023-08-31T00:27:00.316185+0000","last_active":"2023-08-31T00:27:00.318468+0000","last_peered":"2023-08-31T00:27:00.318468+0000","last_clean":"2023-08-31T00:27:00.318468+0000","last_became_active":"2023-08-31T00:27:00.315707+0000","last_became_peered":"2023-08-31T00:27:00.315707+0000","last_unstale":"2023-08-31T00:27:00.318468+0000","last_undegraded":"2023-08-31T00:27:00.318468+0000","last_fullsized":"2023-08-31T00:27:00.318468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300453+0000","last_change":"2023-08-31T00:26:59.313185+0000","last_active":"2023-08-31T00:27:00.300453+0000","last_peered":"2023-08-31T00:27:00.300453+0000","last_clean":"2023-08-31T00:27:00.300453+0000","last_became_active":"2023-08-31T00:26:59.312883+0000","last_became_peered":"2023-08-31T00:26:59.312883+0000","last_unstale":"2023-08-31T00:27:00.300453+0000","last_undegraded":"2023-08-31T00:27:00.300453+0000","last_fullsized":"2023-08-31T00:27:00.300453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311434+0000","last_change":"2023-08-31T00:27:00.307379+0000","last_active":"2023-08-31T00:27:00.311434+0000","last_peered":"2023-08-31T00:27:00.311434+0000","last_clean":"2023-08-31T00:27:00.311434+0000","last_became_active":"2023-08-31T00:27:00.307055+0000","last_became_peered":"2023-08-31T00:27:00.307055+0000","last_unstale":"2023-08-31T00:27:00.311434+0000","last_undegraded":"2023-08-31T00:27:00.311434+0000","last_fullsized":"2023-08-31T00:27:00.311434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:47.503739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330723+0000","last_change":"2023-08-31T00:26:59.312847+0000","last_active":"2023-08-31T00:27:00.330723+0000","last_peered":"2023-08-31T00:27:00.330723+0000","last_clean":"2023-08-31T00:27:00.330723+0000","last_became_active":"2023-08-31T00:26:59.312546+0000","last_became_peered":"2023-08-31T00:26:59.312546+0000","last_unstale":"2023-08-31T00:27:00.330723+0000","last_undegraded":"2023-08-31T00:27:00.330723+0000","last_fullsized":"2023-08-31T00:27:00.330723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.315909+0000","last_change":"2023-08-31T00:27:00.314713+0000","last_active":"2023-08-31T00:27:00.315909+0000","last_peered":"2023-08-31T00:27:00.315909+0000","last_clean":"2023-08-31T00:27:00.315909+0000","last_became_active":"2023-08-31T00:27:00.314421+0000","last_became_peered":"2023-08-31T00:27:00.314421+0000","last_unstale":"2023-08-31T00:27:00.315909+0000","last_undegraded":"2023-08-31T00:27:00.315909+0000","last_fullsized":"2023-08-31T00:27:00.315909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.331388+0000","last_change":"2023-08-31T00:26:59.315973+0000","last_active":"2023-08-31T00:27:00.331388+0000","last_peered":"2023-08-31T00:27:00.331388+0000","last_clean":"2023-08-31T00:27:00.331388+0000","last_became_active":"2023-08-31T00:26:59.315513+0000","last_became_peered":"2023-08-31T00:26:59.315513+0000","last_unstale":"2023-08-31T00:27:00.331388+0000","last_undegraded":"2023-08-31T00:27:00.331388+0000","last_fullsized":"2023-08-31T00:27:00.331388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.315960+0000","last_change":"2023-08-31T00:27:00.314705+0000","last_active":"2023-08-31T00:27:00.315960+0000","last_peered":"2023-08-31T00:27:00.315960+0000","last_clean":"2023-08-31T00:27:00.315960+0000","last_became_active":"2023-08-31T00:27:00.314428+0000","last_became_peered":"2023-08-31T00:27:00.314428+0000","last_unstale":"2023-08-31T00:27:00.315960+0000","last_undegraded":"2023-08-31T00:27:00.315960+0000","last_fullsized":"2023-08-31T00:27:00.315960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.312547+0000","last_change":"2023-08-31T00:26:59.311823+0000","last_active":"2023-08-31T00:27:00.312547+0000","last_peered":"2023-08-31T00:27:00.312547+0000","last_clean":"2023-08-31T00:27:00.312547+0000","last_became_active":"2023-08-31T00:26:59.311483+0000","last_became_peered":"2023-08-31T00:26:59.311483+0000","last_unstale":"2023-08-31T00:27:00.312547+0000","last_undegraded":"2023-08-31T00:27:00.312547+0000","last_fullsized":"2023-08-31T00:27:00.312547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327115+0000","last_change":"2023-08-31T00:27:00.325548+0000","last_active":"2023-08-31T00:27:00.327115+0000","last_peered":"2023-08-31T00:27:00.327115+0000","last_clean":"2023-08-31T00:27:00.327115+0000","last_became_active":"2023-08-31T00:27:00.325055+0000","last_became_peered":"2023-08-31T00:27:00.325055+0000","last_unstale":"2023-08-31T00:27:00.327115+0000","last_undegraded":"2023-08-31T00:27:00.327115+0000","last_fullsized":"2023-08-31T00:27:00.327115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318250+0000","last_change":"2023-08-31T00:26:59.318639+0000","last_active":"2023-08-31T00:27:00.318250+0000","last_peered":"2023-08-31T00:27:00.318250+0000","last_clean":"2023-08-31T00:27:00.318250+0000","last_became_active":"2023-08-31T00:26:59.318291+0000","last_became_peered":"2023-08-31T00:26:59.318291+0000","last_unstale":"2023-08-31T00:27:00.318250+0000","last_undegraded":"2023-08-31T00:27:00.318250+0000","last_fullsized":"2023-08-31T00:27:00.318250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329570+0000","last_change":"2023-08-31T00:27:00.328847+0000","last_active":"2023-08-31T00:27:00.329570+0000","last_peered":"2023-08-31T00:27:00.329570+0000","last_clean":"2023-08-31T00:27:00.329570+0000","last_became_active":"2023-08-31T00:27:00.328588+0000","last_became_peered":"2023-08-31T00:27:00.328588+0000","last_unstale":"2023-08-31T00:27:00.329570+0000","last_undegraded":"2023-08-31T00:27:00.329570+0000","last_fullsized":"2023-08-31T00:27:00.329570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323635+0000","last_change":"2023-08-31T00:27:00.319649+0000","last_active":"2023-08-31T00:27:00.323635+0000","last_peered":"2023-08-31T00:27:00.323635+0000","last_clean":"2023-08-31T00:27:00.323635+0000","last_became_active":"2023-08-31T00:27:00.319365+0000","last_became_peered":"2023-08-31T00:27:00.319365+0000","last_unstale":"2023-08-31T00:27:00.323635+0000","last_undegraded":"2023-08-31T00:27:00.323635+0000","last_fullsized":"2023-08-31T00:27:00.323635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300546+0000","last_change":"2023-08-31T00:26:59.314564+0000","last_active":"2023-08-31T00:27:00.300546+0000","last_peered":"2023-08-31T00:27:00.300546+0000","last_clean":"2023-08-31T00:27:00.300546+0000","last_became_active":"2023-08-31T00:26:59.314296+0000","last_became_peered":"2023-08-31T00:26:59.314296+0000","last_unstale":"2023-08-31T00:27:00.300546+0000","last_undegraded":"2023-08-31T00:27:00.300546+0000","last_fullsized":"2023-08-31T00:27:00.300546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:06.610718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334899+0000","last_change":"2023-08-31T00:27:00.329442+0000","last_active":"2023-08-31T00:27:00.334899+0000","last_peered":"2023-08-31T00:27:00.334899+0000","last_clean":"2023-08-31T00:27:00.334899+0000","last_became_active":"2023-08-31T00:27:00.329237+0000","last_became_peered":"2023-08-31T00:27:00.329237+0000","last_unstale":"2023-08-31T00:27:00.334899+0000","last_undegraded":"2023-08-31T00:27:00.334899+0000","last_fullsized":"2023-08-31T00:27:00.334899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317359+0000","last_change":"2023-08-31T00:26:59.314864+0000","last_active":"2023-08-31T00:27:00.317359+0000","last_peered":"2023-08-31T00:27:00.317359+0000","last_clean":"2023-08-31T00:27:00.317359+0000","last_became_active":"2023-08-31T00:26:59.313879+0000","last_became_peered":"2023-08-31T00:26:59.313879+0000","last_unstale":"2023-08-31T00:27:00.317359+0000","last_undegraded":"2023-08-31T00:27:00.317359+0000","last_fullsized":"2023-08-31T00:27:00.317359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:53.782002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-08-31T00:26:59.315509+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:26:59.315509+0000","last_peered":"2023-08-31T00:26:59.315509+0000","last_clean":"2023-08-31T00:26:59.315509+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:26:59.315509+0000","last_undegraded":"2023-08-31T00:26:59.315509+0000","last_fullsized":"2023-08-31T00:26:59.315509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323487+0000","last_change":"2023-08-31T00:27:00.315831+0000","last_active":"2023-08-31T00:27:00.323487+0000","last_peered":"2023-08-31T00:27:00.323487+0000","last_clean":"2023-08-31T00:27:00.323487+0000","last_became_active":"2023-08-31T00:27:00.315547+0000","last_became_peered":"2023-08-31T00:27:00.315547+0000","last_unstale":"2023-08-31T00:27:00.323487+0000","last_undegraded":"2023-08-31T00:27:00.323487+0000","last_fullsized":"2023-08-31T00:27:00.323487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:47.503739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.305093+0000","last_change":"2023-08-31T00:26:59.323394+0000","last_active":"2023-08-31T00:27:00.305093+0000","last_peered":"2023-08-31T00:27:00.305093+0000","last_clean":"2023-08-31T00:27:00.305093+0000","last_became_active":"2023-08-31T00:26:59.323150+0000","last_became_peered":"2023-08-31T00:26:59.323150+0000","last_unstale":"2023-08-31T00:27:00.305093+0000","last_undegraded":"2023-08-31T00:27:00.305093+0000","last_fullsized":"2023-08-31T00:27:00.305093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.305869+0000","last_change":"2023-08-31T00:26:59.323065+0000","last_active":"2023-08-31T00:27:00.305869+0000","last_peered":"2023-08-31T00:27:00.305869+0000","last_clean":"2023-08-31T00:27:00.305869+0000","last_became_active":"2023-08-31T00:26:59.322673+0000","last_became_peered":"2023-08-31T00:26:59.322673+0000","last_unstale":"2023-08-31T00:27:00.305869+0000","last_undegraded":"2023-08-31T00:27:00.305869+0000","last_fullsized":"2023-08-31T00:27:00.305869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327623+0000","last_change":"2023-08-31T00:27:00.319918+0000","last_active":"2023-08-31T00:27:00.327623+0000","last_peered":"2023-08-31T00:27:00.327623+0000","last_clean":"2023-08-31T00:27:00.327623+0000","last_became_active":"2023-08-31T00:27:00.319656+0000","last_became_peered":"2023-08-31T00:27:00.319656+0000","last_unstale":"2023-08-31T00:27:00.327623+0000","last_undegraded":"2023-08-31T00:27:00.327623+0000","last_fullsized":"2023-08-31T00:27:00.327623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.310353+0000","last_change":"2023-08-31T00:26:59.316728+0000","last_active":"2023-08-31T00:27:00.310353+0000","last_peered":"2023-08-31T00:27:00.310353+0000","last_clean":"2023-08-31T00:27:00.310353+0000","last_became_active":"2023-08-31T00:26:59.316325+0000","last_became_peered":"2023-08-31T00:26:59.316325+0000","last_unstale":"2023-08-31T00:27:00.310353+0000","last_undegraded":"2023-08-31T00:27:00.310353+0000","last_fullsized":"2023-08-31T00:27:00.310353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323478+0000","last_change":"2023-08-31T00:27:00.317323+0000","last_active":"2023-08-31T00:27:00.323478+0000","last_peered":"2023-08-31T00:27:00.323478+0000","last_clean":"2023-08-31T00:27:00.323478+0000","last_became_active":"2023-08-31T00:27:00.317051+0000","last_became_peered":"2023-08-31T00:27:00.317051+0000","last_unstale":"2023-08-31T00:27:00.323478+0000","last_undegraded":"2023-08-31T00:27:00.323478+0000","last_fullsized":"2023-08-31T00:27:00.323478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329234+0000","last_change":"2023-08-31T00:26:59.319291+0000","last_active":"2023-08-31T00:27:00.329234+0000","last_peered":"2023-08-31T00:27:00.329234+0000","last_clean":"2023-08-31T00:27:00.329234+0000","last_became_active":"2023-08-31T00:26:59.318911+0000","last_became_peered":"2023-08-31T00:26:59.318911+0000","last_unstale":"2023-08-31T00:27:00.329234+0000","last_undegraded":"2023-08-31T00:27:00.329234+0000","last_fullsized":"2023-08-31T00:27:00.329234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323397+0000","last_change":"2023-08-31T00:27:00.315232+0000","last_active":"2023-08-31T00:27:00.323397+0000","last_peered":"2023-08-31T00:27:00.323397+0000","last_clean":"2023-08-31T00:27:00.323397+0000","last_became_active":"2023-08-31T00:27:00.314924+0000","last_became_peered":"2023-08-31T00:27:00.314924+0000","last_unstale":"2023-08-31T00:27:00.323397+0000","last_undegraded":"2023-08-31T00:27:00.323397+0000","last_fullsized":"2023-08-31T00:27:00.323397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.304780+0000","last_change":"2023-08-31T00:26:59.322925+0000","last_active":"2023-08-31T00:27:00.304780+0000","last_peered":"2023-08-31T00:27:00.304780+0000","last_clean":"2023-08-31T00:27:00.304780+0000","last_became_active":"2023-08-31T00:26:59.322585+0000","last_became_peered":"2023-08-31T00:26:59.322585+0000","last_unstale":"2023-08-31T00:27:00.304780+0000","last_undegraded":"2023-08-31T00:27:00.304780+0000","last_fullsized":"2023-08-31T00:27:00.304780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.319519+0000","last_change":"2023-08-31T00:27:00.312503+0000","last_active":"2023-08-31T00:27:00.319519+0000","last_peered":"2023-08-31T00:27:00.319519+0000","last_clean":"2023-08-31T00:27:00.319519+0000","last_became_active":"2023-08-31T00:27:00.312047+0000","last_became_peered":"2023-08-31T00:27:00.312047+0000","last_unstale":"2023-08-31T00:27:00.319519+0000","last_undegraded":"2023-08-31T00:27:00.319519+0000","last_fullsized":"2023-08-31T00:27:00.319519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:30:24.334269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311327+0000","last_change":"2023-08-31T00:26:59.317022+0000","last_active":"2023-08-31T00:27:00.311327+0000","last_peered":"2023-08-31T00:27:00.311327+0000","last_clean":"2023-08-31T00:27:00.311327+0000","last_became_active":"2023-08-31T00:26:59.316703+0000","last_became_peered":"2023-08-31T00:26:59.316703+0000","last_unstale":"2023-08-31T00:27:00.311327+0000","last_undegraded":"2023-08-31T00:27:00.311327+0000","last_fullsized":"2023-08-31T00:27:00.311327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323786+0000","last_change":"2023-08-31T00:27:00.317829+0000","last_active":"2023-08-31T00:27:00.323786+0000","last_peered":"2023-08-31T00:27:00.323786+0000","last_clean":"2023-08-31T00:27:00.323786+0000","last_became_active":"2023-08-31T00:27:00.317552+0000","last_became_peered":"2023-08-31T00:27:00.317552+0000","last_unstale":"2023-08-31T00:27:00.323786+0000","last_undegraded":"2023-08-31T00:27:00.323786+0000","last_fullsized":"2023-08-31T00:27:00.323786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.309543+0000","last_change":"2023-08-31T00:26:59.310991+0000","last_active":"2023-08-31T00:27:00.309543+0000","last_peered":"2023-08-31T00:27:00.309543+0000","last_clean":"2023-08-31T00:27:00.309543+0000","last_became_active":"2023-08-31T00:26:59.310696+0000","last_became_peered":"2023-08-31T00:26:59.310696+0000","last_unstale":"2023-08-31T00:27:00.309543+0000","last_undegraded":"2023-08-31T00:27:00.309543+0000","last_fullsized":"2023-08-31T00:27:00.309543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334933+0000","last_change":"2023-08-31T00:27:00.329128+0000","last_active":"2023-08-31T00:27:00.334933+0000","last_peered":"2023-08-31T00:27:00.334933+0000","last_clean":"2023-08-31T00:27:00.334933+0000","last_became_active":"2023-08-31T00:27:00.328627+0000","last_became_peered":"2023-08-31T00:27:00.328627+0000","last_unstale":"2023-08-31T00:27:00.334933+0000","last_undegraded":"2023-08-31T00:27:00.334933+0000","last_fullsized":"2023-08-31T00:27:00.334933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329309+0000","last_change":"2023-08-31T00:26:59.325883+0000","last_active":"2023-08-31T00:27:00.329309+0000","last_peered":"2023-08-31T00:27:00.329309+0000","last_clean":"2023-08-31T00:27:00.329309+0000","last_became_active":"2023-08-31T00:26:59.325639+0000","last_became_peered":"2023-08-31T00:26:59.325639+0000","last_unstale":"2023-08-31T00:27:00.329309+0000","last_undegraded":"2023-08-31T00:27:00.329309+0000","last_fullsized":"2023-08-31T00:27:00.329309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:33.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.312866+0000","last_change":"2023-08-31T00:27:00.312122+0000","last_active":"2023-08-31T00:27:00.312866+0000","last_peered":"2023-08-31T00:27:00.312866+0000","last_clean":"2023-08-31T00:27:00.312866+0000","last_became_active":"2023-08-31T00:27:00.311829+0000","last_became_peered":"2023-08-31T00:27:00.311829+0000","last_unstale":"2023-08-31T00:27:00.312866+0000","last_undegraded":"2023-08-31T00:27:00.312866+0000","last_fullsized":"2023-08-31T00:27:00.312866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300621+0000","last_change":"2023-08-31T00:26:59.321055+0000","last_active":"2023-08-31T00:27:00.300621+0000","last_peered":"2023-08-31T00:27:00.300621+0000","last_clean":"2023-08-31T00:27:00.300621+0000","last_became_active":"2023-08-31T00:26:59.320790+0000","last_became_peered":"2023-08-31T00:26:59.320790+0000","last_unstale":"2023-08-31T00:27:00.300621+0000","last_undegraded":"2023-08-31T00:27:00.300621+0000","last_fullsized":"2023-08-31T00:27:00.300621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326606+0000","last_change":"2023-08-31T00:27:00.325496+0000","last_active":"2023-08-31T00:27:00.326606+0000","last_peered":"2023-08-31T00:27:00.326606+0000","last_clean":"2023-08-31T00:27:00.326606+0000","last_became_active":"2023-08-31T00:27:00.325207+0000","last_became_peered":"2023-08-31T00:27:00.325207+0000","last_unstale":"2023-08-31T00:27:00.326606+0000","last_undegraded":"2023-08-31T00:27:00.326606+0000","last_fullsized":"2023-08-31T00:27:00.326606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330442+0000","last_change":"2023-08-31T00:26:59.311899+0000","last_active":"2023-08-31T00:27:00.330442+0000","last_peered":"2023-08-31T00:27:00.330442+0000","last_clean":"2023-08-31T00:27:00.330442+0000","last_became_active":"2023-08-31T00:26:59.311612+0000","last_became_peered":"2023-08-31T00:26:59.311612+0000","last_unstale":"2023-08-31T00:27:00.330442+0000","last_undegraded":"2023-08-31T00:27:00.330442+0000","last_fullsized":"2023-08-31T00:27:00.330442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338562+0000","last_change":"2023-08-31T00:27:00.334889+0000","last_active":"2023-08-31T00:27:00.338562+0000","last_peered":"2023-08-31T00:27:00.338562+0000","last_clean":"2023-08-31T00:27:00.338562+0000","last_became_active":"2023-08-31T00:27:00.334672+0000","last_became_peered":"2023-08-31T00:27:00.334672+0000","last_unstale":"2023-08-31T00:27:00.338562+0000","last_undegraded":"2023-08-31T00:27:00.338562+0000","last_fullsized":"2023-08-31T00:27:00.338562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.335058+0000","last_change":"2023-08-31T00:26:59.311633+0000","last_active":"2023-08-31T00:27:00.335058+0000","last_peered":"2023-08-31T00:27:00.335058+0000","last_clean":"2023-08-31T00:27:00.335058+0000","last_became_active":"2023-08-31T00:26:59.311354+0000","last_became_peered":"2023-08-31T00:26:59.311354+0000","last_unstale":"2023-08-31T00:27:00.335058+0000","last_undegraded":"2023-08-31T00:27:00.335058+0000","last_fullsized":"2023-08-31T00:27:00.335058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320682+0000","last_change":"2023-08-31T00:27:00.318313+0000","last_active":"2023-08-31T00:27:00.320682+0000","last_peered":"2023-08-31T00:27:00.320682+0000","last_clean":"2023-08-31T00:27:00.320682+0000","last_became_active":"2023-08-31T00:27:00.318100+0000","last_became_peered":"2023-08-31T00:27:00.318100+0000","last_unstale":"2023-08-31T00:27:00.320682+0000","last_undegraded":"2023-08-31T00:27:00.320682+0000","last_fullsized":"2023-08-31T00:27:00.320682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311454+0000","last_change":"2023-08-31T00:27:00.307564+0000","last_active":"2023-08-31T00:27:00.311454+0000","last_peered":"2023-08-31T00:27:00.311454+0000","last_clean":"2023-08-31T00:27:00.311454+0000","last_became_active":"2023-08-31T00:27:00.307264+0000","last_became_peered":"2023-08-31T00:27:00.307264+0000","last_unstale":"2023-08-31T00:27:00.311454+0000","last_undegraded":"2023-08-31T00:27:00.311454+0000","last_fullsized":"2023-08-31T00:27:00.311454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329218+0000","last_change":"2023-08-31T00:27:00.322552+0000","last_active":"2023-08-31T00:27:00.329218+0000","last_peered":"2023-08-31T00:27:00.329218+0000","last_clean":"2023-08-31T00:27:00.329218+0000","last_became_active":"2023-08-31T00:27:00.322254+0000","last_became_peered":"2023-08-31T00:27:00.322254+0000","last_unstale":"2023-08-31T00:27:00.329218+0000","last_undegraded":"2023-08-31T00:27:00.329218+0000","last_fullsized":"2023-08-31T00:27:00.329218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338575+0000","last_change":"2023-08-31T00:27:00.334929+0000","last_active":"2023-08-31T00:27:00.338575+0000","last_peered":"2023-08-31T00:27:00.338575+0000","last_clean":"2023-08-31T00:27:00.338575+0000","last_became_active":"2023-08-31T00:27:00.334671+0000","last_became_peered":"2023-08-31T00:27:00.334671+0000","last_unstale":"2023-08-31T00:27:00.338575+0000","last_undegraded":"2023-08-31T00:27:00.338575+0000","last_fullsized":"2023-08-31T00:27:00.338575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.331038+0000","last_change":"2023-08-31T00:27:00.327878+0000","last_active":"2023-08-31T00:27:00.331038+0000","last_peered":"2023-08-31T00:27:00.331038+0000","last_clean":"2023-08-31T00:27:00.331038+0000","last_became_active":"2023-08-31T00:27:00.327570+0000","last_became_peered":"2023-08-31T00:27:00.327570+0000","last_unstale":"2023-08-31T00:27:00.331038+0000","last_undegraded":"2023-08-31T00:27:00.331038+0000","last_fullsized":"2023-08-31T00:27:00.331038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334427+0000","last_change":"2023-08-31T00:27:00.321837+0000","last_active":"2023-08-31T00:27:00.334427+0000","last_peered":"2023-08-31T00:27:00.334427+0000","last_clean":"2023-08-31T00:27:00.334427+0000","last_became_active":"2023-08-31T00:27:00.321561+0000","last_became_peered":"2023-08-31T00:27:00.321561+0000","last_unstale":"2023-08-31T00:27:00.334427+0000","last_undegraded":"2023-08-31T00:27:00.334427+0000","last_fullsized":"2023-08-31T00:27:00.334427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328523+0000","last_change":"2023-08-31T00:27:00.322796+0000","last_active":"2023-08-31T00:27:00.328523+0000","last_peered":"2023-08-31T00:27:00.328523+0000","last_clean":"2023-08-31T00:27:00.328523+0000","last_became_active":"2023-08-31T00:27:00.322507+0000","last_became_peered":"2023-08-31T00:27:00.322507+0000","last_unstale":"2023-08-31T00:27:00.328523+0000","last_undegraded":"2023-08-31T00:27:00.328523+0000","last_fullsized":"2023-08-31T00:27:00.328523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.313415+0000","last_change":"2023-08-31T00:27:00.311231+0000","last_active":"2023-08-31T00:27:00.313415+0000","last_peered":"2023-08-31T00:27:00.313415+0000","last_clean":"2023-08-31T00:27:00.313415+0000","last_became_active":"2023-08-31T00:27:00.310948+0000","last_became_peered":"2023-08-31T00:27:00.310948+0000","last_unstale":"2023-08-31T00:27:00.313415+0000","last_undegraded":"2023-08-31T00:27:00.313415+0000","last_fullsized":"2023-08-31T00:27:00.313415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334324+0000","last_change":"2023-08-31T00:27:00.321793+0000","last_active":"2023-08-31T00:27:00.334324+0000","last_peered":"2023-08-31T00:27:00.334324+0000","last_clean":"2023-08-31T00:27:00.334324+0000","last_became_active":"2023-08-31T00:27:00.321498+0000","last_became_peered":"2023-08-31T00:27:00.321498+0000","last_unstale":"2023-08-31T00:27:00.334324+0000","last_undegraded":"2023-08-31T00:27:00.334324+0000","last_fullsized":"2023-08-31T00:27:00.334324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330344+0000","last_change":"2023-08-31T00:27:00.327048+0000","last_active":"2023-08-31T00:27:00.330344+0000","last_peered":"2023-08-31T00:27:00.330344+0000","last_clean":"2023-08-31T00:27:00.330344+0000","last_became_active":"2023-08-31T00:27:00.326522+0000","last_became_peered":"2023-08-31T00:27:00.326522+0000","last_unstale":"2023-08-31T00:27:00.330344+0000","last_undegraded":"2023-08-31T00:27:00.330344+0000","last_fullsized":"2023-08-31T00:27:00.330344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334366+0000","last_change":"2023-08-31T00:27:00.322224+0000","last_active":"2023-08-31T00:27:00.334366+0000","last_peered":"2023-08-31T00:27:00.334366+0000","last_clean":"2023-08-31T00:27:00.334366+0000","last_became_active":"2023-08-31T00:27:00.321978+0000","last_became_peered":"2023-08-31T00:27:00.321978+0000","last_unstale":"2023-08-31T00:27:00.334366+0000","last_undegraded":"2023-08-31T00:27:00.334366+0000","last_fullsized":"2023-08-31T00:27:00.334366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330442+0000","last_change":"2023-08-31T00:27:00.327229+0000","last_active":"2023-08-31T00:27:00.330442+0000","last_peered":"2023-08-31T00:27:00.330442+0000","last_clean":"2023-08-31T00:27:00.330442+0000","last_became_active":"2023-08-31T00:27:00.326932+0000","last_became_peered":"2023-08-31T00:27:00.326932+0000","last_unstale":"2023-08-31T00:27:00.330442+0000","last_undegraded":"2023-08-31T00:27:00.330442+0000","last_fullsized":"2023-08-31T00:27:00.330442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.319001+0000","last_change":"2023-08-31T00:27:00.313686+0000","last_active":"2023-08-31T00:27:00.319001+0000","last_peered":"2023-08-31T00:27:00.319001+0000","last_clean":"2023-08-31T00:27:00.319001+0000","last_became_active":"2023-08-31T00:27:00.313386+0000","last_became_peered":"2023-08-31T00:27:00.313386+0000","last_unstale":"2023-08-31T00:27:00.319001+0000","last_undegraded":"2023-08-31T00:27:00.319001+0000","last_fullsized":"2023-08-31T00:27:00.319001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:30:24.334269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.319219+0000","last_change":"2023-08-31T00:27:00.316315+0000","last_active":"2023-08-31T00:27:00.319219+0000","last_peered":"2023-08-31T00:27:00.319219+0000","last_clean":"2023-08-31T00:27:00.319219+0000","last_became_active":"2023-08-31T00:27:00.313982+0000","last_became_peered":"2023-08-31T00:27:00.313982+0000","last_unstale":"2023-08-31T00:27:00.319219+0000","last_undegraded":"2023-08-31T00:27:00.319219+0000","last_fullsized":"2023-08-31T00:27:00.319219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9079999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5630000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2130000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.524}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3730000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:27:04.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:27:04.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 -- 172.21.15.77:0/2887876561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 msgr2=0x7f16300c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 --2- 172.21.15.77:0/2887876561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c9800 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16200098c0 tx=0x7f1620009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 -- 172.21.15.77:0/2887876561 shutdown_connections 2023-08-31T00:27:04.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 --2- 172.21.15.77:0/2887876561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c9800 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 -- 172.21.15.77:0/2887876561 >> 172.21.15.77:0/2887876561 conn(0x7f16300cbc30 msgr2=0x7f16300cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:04.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 -- 172.21.15.77:0/2887876561 shutdown_connections 2023-08-31T00:27:04.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.568+0000 7f1635401700 1 -- 172.21.15.77:0/2887876561 wait complete. 2023-08-31T00:27:04.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.569+0000 7f1635401700 1 Processor -- start 2023-08-31T00:27:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.570+0000 7f1635401700 1 -- start start 2023-08-31T00:27:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.570+0000 7f1635401700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f16300b1340 0x7f16301f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.570+0000 7f1635401700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16300c9d40 0x7f16301f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.570+0000 7f1635401700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.570+0000 7f1635401700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16301f4260 con 0x7f1630159450 2023-08-31T00:27:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f1635401700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16301579b0 con 0x7f16300c9d40 2023-08-31T00:27:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f1635401700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16301f39c0 con 0x7f16300b1340 2023-08-31T00:27:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38452/0 (socket says 172.21.15.77:38452) 2023-08-31T00:27:04.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 -- 172.21.15.77:0/1670390760 learned_addr learned my addr 172.21.15.77:0/1670390760 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:04.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162e7fc700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16300c9d40 0x7f16301f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162effd700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f16300b1340 0x7f16301f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 -- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f16300b1340 msgr2=0x7f16301f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f16300b1340 0x7f16301f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 -- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16300c9d40 msgr2=0x7f16301f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16300c9d40 0x7f16301f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 -- 172.21.15.77:0/1670390760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620009520 con 0x7f1630159450 2023-08-31T00:27:04.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f162f7fe700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c7e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f162800cc10 tx=0x7f1628004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:04.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162800ab80 con 0x7f1630159450 2023-08-31T00:27:04.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f162800add0 con 0x7f1630159450 2023-08-31T00:27:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16301f3ca0 con 0x7f1630159450 2023-08-31T00:27:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628012680 con 0x7f1630159450 2023-08-31T00:27:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.571+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16300c63b0 con 0x7f1630159450 2023-08-31T00:27:04.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.572+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16300c65d0 con 0x7f1630159450 2023-08-31T00:27:04.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.573+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f162801b400 con 0x7f1630159450 2023-08-31T00:27:04.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.573+0000 7f16177fe700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f161c06a110 0x7f161c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.573+0000 7f162effd700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f161c06a110 0x7f161c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.573+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1628088d80 con 0x7f1630159450 2023-08-31T00:27:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.573+0000 7f162effd700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f161c06a110 0x7f161c06c5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1620009230 tx=0x7f1620011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.577+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1628054570 con 0x7f1630159450 2023-08-31T00:27:04.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.763+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16300cb7f0 con 0x7f161c06a110 2023-08-31T00:27:04.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.769+0000 7f16177fe700 1 -- 172.21.15.77:0/1670390760 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264630 (secure 0 0 0) 0x7f16300cb7f0 con 0x7f161c06a110 2023-08-31T00:27:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:04.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f161c06a110 msgr2=0x7f161c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f161c06a110 0x7f161c06c5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1620009230 tx=0x7f1620011040 comp rx=0 tx=0).stop 2023-08-31T00:27:04.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 msgr2=0x7f16300c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c7e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f162800cc10 tx=0x7f1628004990 comp rx=0 tx=0).stop 2023-08-31T00:27:04.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 shutdown_connections 2023-08-31T00:27:04.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f161c06a110 0x7f161c06c5d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f16300b1340 0x7f16301f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1630159450 0x7f16300c7e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 --2- 172.21.15.77:0/1670390760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16300c9d40 0x7f16301f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 >> 172.21.15.77:0/1670390760 conn(0x7f16300cbc30 msgr2=0x7f16300aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 shutdown_connections 2023-08-31T00:27:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.772+0000 7f1635401700 1 -- 172.21.15.77:0/1670390760 wait complete. 2023-08-31T00:27:04.778 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:27:04.785 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-08-31T00:27:04.117266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218768,"kb_used_data":2596,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755952,"statfs":{"total":773094113280,"available":772870094848,"internally_reserved":0,"allocated":2658304,"data_stored":1657452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.828142"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318384+0000","last_change":"2023-08-31T00:27:00.316606+0000","last_active":"2023-08-31T00:27:00.318384+0000","last_peered":"2023-08-31T00:27:00.318384+0000","last_clean":"2023-08-31T00:27:00.318384+0000","last_became_active":"2023-08-31T00:27:00.316335+0000","last_became_peered":"2023-08-31T00:27:00.316335+0000","last_unstale":"2023-08-31T00:27:00.318384+0000","last_undegraded":"2023-08-31T00:27:00.318384+0000","last_fullsized":"2023-08-31T00:27:00.318384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323653+0000","last_change":"2023-08-31T00:27:00.319751+0000","last_active":"2023-08-31T00:27:00.323653+0000","last_peered":"2023-08-31T00:27:00.323653+0000","last_clean":"2023-08-31T00:27:00.323653+0000","last_became_active":"2023-08-31T00:27:00.319480+0000","last_became_peered":"2023-08-31T00:27:00.319480+0000","last_unstale":"2023-08-31T00:27:00.323653+0000","last_undegraded":"2023-08-31T00:27:00.323653+0000","last_fullsized":"2023-08-31T00:27:00.323653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323058+0000","last_change":"2023-08-31T00:27:00.314460+0000","last_active":"2023-08-31T00:27:00.323058+0000","last_peered":"2023-08-31T00:27:00.323058+0000","last_clean":"2023-08-31T00:27:00.323058+0000","last_became_active":"2023-08-31T00:27:00.314165+0000","last_became_peered":"2023-08-31T00:27:00.314165+0000","last_unstale":"2023-08-31T00:27:00.323058+0000","last_undegraded":"2023-08-31T00:27:00.323058+0000","last_fullsized":"2023-08-31T00:27:00.323058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.335665+0000","last_change":"2023-08-31T00:27:00.330366+0000","last_active":"2023-08-31T00:27:00.335665+0000","last_peered":"2023-08-31T00:27:00.335665+0000","last_clean":"2023-08-31T00:27:00.335665+0000","last_became_active":"2023-08-31T00:27:00.330034+0000","last_became_peered":"2023-08-31T00:27:00.330034+0000","last_unstale":"2023-08-31T00:27:00.335665+0000","last_undegraded":"2023-08-31T00:27:00.335665+0000","last_fullsized":"2023-08-31T00:27:00.335665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318448+0000","last_change":"2023-08-31T00:27:00.315980+0000","last_active":"2023-08-31T00:27:00.318448+0000","last_peered":"2023-08-31T00:27:00.318448+0000","last_clean":"2023-08-31T00:27:00.318448+0000","last_became_active":"2023-08-31T00:27:00.315408+0000","last_became_peered":"2023-08-31T00:27:00.315408+0000","last_unstale":"2023-08-31T00:27:00.318448+0000","last_undegraded":"2023-08-31T00:27:00.318448+0000","last_fullsized":"2023-08-31T00:27:00.318448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330461+0000","last_change":"2023-08-31T00:27:00.327757+0000","last_active":"2023-08-31T00:27:00.330461+0000","last_peered":"2023-08-31T00:27:00.330461+0000","last_clean":"2023-08-31T00:27:00.330461+0000","last_became_active":"2023-08-31T00:27:00.327504+0000","last_became_peered":"2023-08-31T00:27:00.327504+0000","last_unstale":"2023-08-31T00:27:00.330461+0000","last_undegraded":"2023-08-31T00:27:00.330461+0000","last_fullsized":"2023-08-31T00:27:00.330461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.324716+0000","last_change":"2023-08-31T00:27:00.319958+0000","last_active":"2023-08-31T00:27:00.324716+0000","last_peered":"2023-08-31T00:27:00.324716+0000","last_clean":"2023-08-31T00:27:00.324716+0000","last_became_active":"2023-08-31T00:27:00.319594+0000","last_became_peered":"2023-08-31T00:27:00.319594+0000","last_unstale":"2023-08-31T00:27:00.324716+0000","last_undegraded":"2023-08-31T00:27:00.324716+0000","last_fullsized":"2023-08-31T00:27:00.324716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334968+0000","last_change":"2023-08-31T00:27:00.327585+0000","last_active":"2023-08-31T00:27:00.334968+0000","last_peered":"2023-08-31T00:27:00.334968+0000","last_clean":"2023-08-31T00:27:00.334968+0000","last_became_active":"2023-08-31T00:27:00.324961+0000","last_became_peered":"2023-08-31T00:27:00.324961+0000","last_unstale":"2023-08-31T00:27:00.334968+0000","last_undegraded":"2023-08-31T00:27:00.334968+0000","last_fullsized":"2023-08-31T00:27:00.334968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326546+0000","last_change":"2023-08-31T00:27:00.325501+0000","last_active":"2023-08-31T00:27:00.326546+0000","last_peered":"2023-08-31T00:27:00.326546+0000","last_clean":"2023-08-31T00:27:00.326546+0000","last_became_active":"2023-08-31T00:27:00.325229+0000","last_became_peered":"2023-08-31T00:27:00.325229+0000","last_unstale":"2023-08-31T00:27:00.326546+0000","last_undegraded":"2023-08-31T00:27:00.326546+0000","last_fullsized":"2023-08-31T00:27:00.326546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328627+0000","last_change":"2023-08-31T00:27:00.324789+0000","last_active":"2023-08-31T00:27:00.328627+0000","last_peered":"2023-08-31T00:27:00.328627+0000","last_clean":"2023-08-31T00:27:00.328627+0000","last_became_active":"2023-08-31T00:27:00.324505+0000","last_became_peered":"2023-08-31T00:27:00.324505+0000","last_unstale":"2023-08-31T00:27:00.328627+0000","last_undegraded":"2023-08-31T00:27:00.328627+0000","last_fullsized":"2023-08-31T00:27:00.328627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328591+0000","last_change":"2023-08-31T00:27:00.324716+0000","last_active":"2023-08-31T00:27:00.328591+0000","last_peered":"2023-08-31T00:27:00.328591+0000","last_clean":"2023-08-31T00:27:00.328591+0000","last_became_active":"2023-08-31T00:27:00.324443+0000","last_became_peered":"2023-08-31T00:27:00.324443+0000","last_unstale":"2023-08-31T00:27:00.328591+0000","last_undegraded":"2023-08-31T00:27:00.328591+0000","last_fullsized":"2023-08-31T00:27:00.328591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320205+0000","last_change":"2023-08-31T00:27:00.312173+0000","last_active":"2023-08-31T00:27:00.320205+0000","last_peered":"2023-08-31T00:27:00.320205+0000","last_clean":"2023-08-31T00:27:00.320205+0000","last_became_active":"2023-08-31T00:27:00.311885+0000","last_became_peered":"2023-08-31T00:27:00.311885+0000","last_unstale":"2023-08-31T00:27:00.320205+0000","last_undegraded":"2023-08-31T00:27:00.320205+0000","last_fullsized":"2023-08-31T00:27:00.320205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:47.503739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334542+0000","last_change":"2023-08-31T00:27:00.323165+0000","last_active":"2023-08-31T00:27:00.334542+0000","last_peered":"2023-08-31T00:27:00.334542+0000","last_clean":"2023-08-31T00:27:00.334542+0000","last_became_active":"2023-08-31T00:27:00.322854+0000","last_became_peered":"2023-08-31T00:27:00.322854+0000","last_unstale":"2023-08-31T00:27:00.334542+0000","last_undegraded":"2023-08-31T00:27:00.334542+0000","last_fullsized":"2023-08-31T00:27:00.334542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.322228+0000","last_change":"2023-08-31T00:27:00.312986+0000","last_active":"2023-08-31T00:27:00.322228+0000","last_peered":"2023-08-31T00:27:00.322228+0000","last_clean":"2023-08-31T00:27:00.322228+0000","last_became_active":"2023-08-31T00:27:00.312500+0000","last_became_peered":"2023-08-31T00:27:00.312500+0000","last_unstale":"2023-08-31T00:27:00.322228+0000","last_undegraded":"2023-08-31T00:27:00.322228+0000","last_fullsized":"2023-08-31T00:27:00.322228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317911+0000","last_change":"2023-08-31T00:27:00.314835+0000","last_active":"2023-08-31T00:27:00.317911+0000","last_peered":"2023-08-31T00:27:00.317911+0000","last_clean":"2023-08-31T00:27:00.317911+0000","last_became_active":"2023-08-31T00:27:00.314578+0000","last_became_peered":"2023-08-31T00:27:00.314578+0000","last_unstale":"2023-08-31T00:27:00.317911+0000","last_undegraded":"2023-08-31T00:27:00.317911+0000","last_fullsized":"2023-08-31T00:27:00.317911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330395+0000","last_change":"2023-08-31T00:27:00.327680+0000","last_active":"2023-08-31T00:27:00.330395+0000","last_peered":"2023-08-31T00:27:00.330395+0000","last_clean":"2023-08-31T00:27:00.330395+0000","last_became_active":"2023-08-31T00:27:00.327418+0000","last_became_peered":"2023-08-31T00:27:00.327418+0000","last_unstale":"2023-08-31T00:27:00.330395+0000","last_undegraded":"2023-08-31T00:27:00.330395+0000","last_fullsized":"2023-08-31T00:27:00.330395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330383+0000","last_change":"2023-08-31T00:27:00.327254+0000","last_active":"2023-08-31T00:27:00.330383+0000","last_peered":"2023-08-31T00:27:00.330383+0000","last_clean":"2023-08-31T00:27:00.330383+0000","last_became_active":"2023-08-31T00:27:00.326713+0000","last_became_peered":"2023-08-31T00:27:00.326713+0000","last_unstale":"2023-08-31T00:27:00.330383+0000","last_undegraded":"2023-08-31T00:27:00.330383+0000","last_fullsized":"2023-08-31T00:27:00.330383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.308891+0000","last_change":"2023-08-31T00:27:00.303375+0000","last_active":"2023-08-31T00:27:00.308891+0000","last_peered":"2023-08-31T00:27:00.308891+0000","last_clean":"2023-08-31T00:27:00.308891+0000","last_became_active":"2023-08-31T00:27:00.303086+0000","last_became_peered":"2023-08-31T00:27:00.303086+0000","last_unstale":"2023-08-31T00:27:00.308891+0000","last_undegraded":"2023-08-31T00:27:00.308891+0000","last_fullsized":"2023-08-31T00:27:00.308891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.316748+0000","last_change":"2023-08-31T00:27:00.315115+0000","last_active":"2023-08-31T00:27:00.316748+0000","last_peered":"2023-08-31T00:27:00.316748+0000","last_clean":"2023-08-31T00:27:00.316748+0000","last_became_active":"2023-08-31T00:27:00.314835+0000","last_became_peered":"2023-08-31T00:27:00.314835+0000","last_unstale":"2023-08-31T00:27:00.316748+0000","last_undegraded":"2023-08-31T00:27:00.316748+0000","last_fullsized":"2023-08-31T00:27:00.316748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338760+0000","last_change":"2023-08-31T00:26:59.319947+0000","last_active":"2023-08-31T00:27:00.338760+0000","last_peered":"2023-08-31T00:27:00.338760+0000","last_clean":"2023-08-31T00:27:00.338760+0000","last_became_active":"2023-08-31T00:26:59.319620+0000","last_became_peered":"2023-08-31T00:26:59.319620+0000","last_unstale":"2023-08-31T00:27:00.338760+0000","last_undegraded":"2023-08-31T00:27:00.338760+0000","last_fullsized":"2023-08-31T00:27:00.338760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.324819+0000","last_change":"2023-08-31T00:27:00.318524+0000","last_active":"2023-08-31T00:27:00.324819+0000","last_peered":"2023-08-31T00:27:00.324819+0000","last_clean":"2023-08-31T00:27:00.324819+0000","last_became_active":"2023-08-31T00:27:00.318265+0000","last_became_peered":"2023-08-31T00:27:00.318265+0000","last_unstale":"2023-08-31T00:27:00.324819+0000","last_undegraded":"2023-08-31T00:27:00.324819+0000","last_fullsized":"2023-08-31T00:27:00.324819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334577+0000","last_change":"2023-08-31T00:26:59.307239+0000","last_active":"2023-08-31T00:27:00.334577+0000","last_peered":"2023-08-31T00:27:00.334577+0000","last_clean":"2023-08-31T00:27:00.334577+0000","last_became_active":"2023-08-31T00:26:59.306693+0000","last_became_peered":"2023-08-31T00:26:59.306693+0000","last_unstale":"2023-08-31T00:27:00.334577+0000","last_undegraded":"2023-08-31T00:27:00.334577+0000","last_fullsized":"2023-08-31T00:27:00.334577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326807+0000","last_change":"2023-08-31T00:27:00.324786+0000","last_active":"2023-08-31T00:27:00.326807+0000","last_peered":"2023-08-31T00:27:00.326807+0000","last_clean":"2023-08-31T00:27:00.326807+0000","last_became_active":"2023-08-31T00:27:00.324524+0000","last_became_peered":"2023-08-31T00:27:00.324524+0000","last_unstale":"2023-08-31T00:27:00.326807+0000","last_undegraded":"2023-08-31T00:27:00.326807+0000","last_fullsized":"2023-08-31T00:27:00.326807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328503+0000","last_change":"2023-08-31T00:26:59.326328+0000","last_active":"2023-08-31T00:27:00.328503+0000","last_peered":"2023-08-31T00:27:00.328503+0000","last_clean":"2023-08-31T00:27:00.328503+0000","last_became_active":"2023-08-31T00:26:59.326028+0000","last_became_peered":"2023-08-31T00:26:59.326028+0000","last_unstale":"2023-08-31T00:27:00.328503+0000","last_undegraded":"2023-08-31T00:27:00.328503+0000","last_fullsized":"2023-08-31T00:27:00.328503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326606+0000","last_change":"2023-08-31T00:27:00.321637+0000","last_active":"2023-08-31T00:27:00.326606+0000","last_peered":"2023-08-31T00:27:00.326606+0000","last_clean":"2023-08-31T00:27:00.326606+0000","last_became_active":"2023-08-31T00:27:00.321377+0000","last_became_peered":"2023-08-31T00:27:00.321377+0000","last_unstale":"2023-08-31T00:27:00.326606+0000","last_undegraded":"2023-08-31T00:27:00.326606+0000","last_fullsized":"2023-08-31T00:27:00.326606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327798+0000","last_change":"2023-08-31T00:26:59.326471+0000","last_active":"2023-08-31T00:27:00.327798+0000","last_peered":"2023-08-31T00:27:00.327798+0000","last_clean":"2023-08-31T00:27:00.327798+0000","last_became_active":"2023-08-31T00:26:59.326163+0000","last_became_peered":"2023-08-31T00:26:59.326163+0000","last_unstale":"2023-08-31T00:27:00.327798+0000","last_undegraded":"2023-08-31T00:27:00.327798+0000","last_fullsized":"2023-08-31T00:27:00.327798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327047+0000","last_change":"2023-08-31T00:27:00.322301+0000","last_active":"2023-08-31T00:27:00.327047+0000","last_peered":"2023-08-31T00:27:00.327047+0000","last_clean":"2023-08-31T00:27:00.327047+0000","last_became_active":"2023-08-31T00:27:00.321299+0000","last_became_peered":"2023-08-31T00:27:00.321299+0000","last_unstale":"2023-08-31T00:27:00.327047+0000","last_undegraded":"2023-08-31T00:27:00.327047+0000","last_fullsized":"2023-08-31T00:27:00.327047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334465+0000","last_change":"2023-08-31T00:26:59.316902+0000","last_active":"2023-08-31T00:27:00.334465+0000","last_peered":"2023-08-31T00:27:00.334465+0000","last_clean":"2023-08-31T00:27:00.334465+0000","last_became_active":"2023-08-31T00:26:59.316643+0000","last_became_peered":"2023-08-31T00:26:59.316643+0000","last_unstale":"2023-08-31T00:27:00.334465+0000","last_undegraded":"2023-08-31T00:27:00.334465+0000","last_fullsized":"2023-08-31T00:27:00.334465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:42.963922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320262+0000","last_change":"2023-08-31T00:27:00.316602+0000","last_active":"2023-08-31T00:27:00.320262+0000","last_peered":"2023-08-31T00:27:00.320262+0000","last_clean":"2023-08-31T00:27:00.320262+0000","last_became_active":"2023-08-31T00:27:00.316285+0000","last_became_peered":"2023-08-31T00:27:00.316285+0000","last_unstale":"2023-08-31T00:27:00.320262+0000","last_undegraded":"2023-08-31T00:27:00.320262+0000","last_fullsized":"2023-08-31T00:27:00.320262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:57:49.440198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329504+0000","last_change":"2023-08-31T00:26:59.314263+0000","last_active":"2023-08-31T00:27:00.329504+0000","last_peered":"2023-08-31T00:27:00.329504+0000","last_clean":"2023-08-31T00:27:00.329504+0000","last_became_active":"2023-08-31T00:26:59.314015+0000","last_became_peered":"2023-08-31T00:26:59.314015+0000","last_unstale":"2023-08-31T00:27:00.329504+0000","last_undegraded":"2023-08-31T00:27:00.329504+0000","last_fullsized":"2023-08-31T00:27:00.329504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323792+0000","last_change":"2023-08-31T00:27:00.315878+0000","last_active":"2023-08-31T00:27:00.323792+0000","last_peered":"2023-08-31T00:27:00.323792+0000","last_clean":"2023-08-31T00:27:00.323792+0000","last_became_active":"2023-08-31T00:27:00.315491+0000","last_became_peered":"2023-08-31T00:27:00.315491+0000","last_unstale":"2023-08-31T00:27:00.323792+0000","last_undegraded":"2023-08-31T00:27:00.323792+0000","last_fullsized":"2023-08-31T00:27:00.323792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311091+0000","last_change":"2023-08-31T00:26:59.313625+0000","last_active":"2023-08-31T00:27:00.311091+0000","last_peered":"2023-08-31T00:27:00.311091+0000","last_clean":"2023-08-31T00:27:00.311091+0000","last_became_active":"2023-08-31T00:26:59.313352+0000","last_became_peered":"2023-08-31T00:26:59.313352+0000","last_unstale":"2023-08-31T00:27:00.311091+0000","last_undegraded":"2023-08-31T00:27:00.311091+0000","last_fullsized":"2023-08-31T00:27:00.311091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334988+0000","last_change":"2023-08-31T00:27:00.328716+0000","last_active":"2023-08-31T00:27:00.334988+0000","last_peered":"2023-08-31T00:27:00.334988+0000","last_clean":"2023-08-31T00:27:00.334988+0000","last_became_active":"2023-08-31T00:27:00.328462+0000","last_became_peered":"2023-08-31T00:27:00.328462+0000","last_unstale":"2023-08-31T00:27:00.334988+0000","last_undegraded":"2023-08-31T00:27:00.334988+0000","last_fullsized":"2023-08-31T00:27:00.334988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317404+0000","last_change":"2023-08-31T00:26:59.318075+0000","last_active":"2023-08-31T00:27:00.317404+0000","last_peered":"2023-08-31T00:27:00.317404+0000","last_clean":"2023-08-31T00:27:00.317404+0000","last_became_active":"2023-08-31T00:26:59.314966+0000","last_became_peered":"2023-08-31T00:26:59.314966+0000","last_unstale":"2023-08-31T00:27:00.317404+0000","last_undegraded":"2023-08-31T00:27:00.317404+0000","last_fullsized":"2023-08-31T00:27:00.317404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327631+0000","last_change":"2023-08-31T00:27:00.322612+0000","last_active":"2023-08-31T00:27:00.327631+0000","last_peered":"2023-08-31T00:27:00.327631+0000","last_clean":"2023-08-31T00:27:00.327631+0000","last_became_active":"2023-08-31T00:27:00.322332+0000","last_became_peered":"2023-08-31T00:27:00.322332+0000","last_unstale":"2023-08-31T00:27:00.327631+0000","last_undegraded":"2023-08-31T00:27:00.327631+0000","last_fullsized":"2023-08-31T00:27:00.327631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300853+0000","last_change":"2023-08-31T00:26:59.317148+0000","last_active":"2023-08-31T00:27:00.300853+0000","last_peered":"2023-08-31T00:27:00.300853+0000","last_clean":"2023-08-31T00:27:00.300853+0000","last_became_active":"2023-08-31T00:26:59.316679+0000","last_became_peered":"2023-08-31T00:26:59.316679+0000","last_unstale":"2023-08-31T00:27:00.300853+0000","last_undegraded":"2023-08-31T00:27:00.300853+0000","last_fullsized":"2023-08-31T00:27:00.300853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330418+0000","last_change":"2023-08-31T00:27:00.327124+0000","last_active":"2023-08-31T00:27:00.330418+0000","last_peered":"2023-08-31T00:27:00.330418+0000","last_clean":"2023-08-31T00:27:00.330418+0000","last_became_active":"2023-08-31T00:27:00.326440+0000","last_became_peered":"2023-08-31T00:27:00.326440+0000","last_unstale":"2023-08-31T00:27:00.330418+0000","last_undegraded":"2023-08-31T00:27:00.330418+0000","last_fullsized":"2023-08-31T00:27:00.330418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317629+0000","last_change":"2023-08-31T00:26:59.319209+0000","last_active":"2023-08-31T00:27:00.317629+0000","last_peered":"2023-08-31T00:27:00.317629+0000","last_clean":"2023-08-31T00:27:00.317629+0000","last_became_active":"2023-08-31T00:26:59.318940+0000","last_became_peered":"2023-08-31T00:26:59.318940+0000","last_unstale":"2023-08-31T00:27:00.317629+0000","last_undegraded":"2023-08-31T00:27:00.317629+0000","last_fullsized":"2023-08-31T00:27:00.317629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:14.443886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326783+0000","last_change":"2023-08-31T00:27:00.321858+0000","last_active":"2023-08-31T00:27:00.326783+0000","last_peered":"2023-08-31T00:27:00.326783+0000","last_clean":"2023-08-31T00:27:00.326783+0000","last_became_active":"2023-08-31T00:27:00.321595+0000","last_became_peered":"2023-08-31T00:27:00.321595+0000","last_unstale":"2023-08-31T00:27:00.326783+0000","last_undegraded":"2023-08-31T00:27:00.326783+0000","last_fullsized":"2023-08-31T00:27:00.326783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.331080+0000","last_change":"2023-08-31T00:26:59.317069+0000","last_active":"2023-08-31T00:27:00.331080+0000","last_peered":"2023-08-31T00:27:00.331080+0000","last_clean":"2023-08-31T00:27:00.331080+0000","last_became_active":"2023-08-31T00:26:59.316783+0000","last_became_peered":"2023-08-31T00:26:59.316783+0000","last_unstale":"2023-08-31T00:27:00.331080+0000","last_undegraded":"2023-08-31T00:27:00.331080+0000","last_fullsized":"2023-08-31T00:27:00.331080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:12.495239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320422+0000","last_change":"2023-08-31T00:27:00.317789+0000","last_active":"2023-08-31T00:27:00.320422+0000","last_peered":"2023-08-31T00:27:00.320422+0000","last_clean":"2023-08-31T00:27:00.320422+0000","last_became_active":"2023-08-31T00:27:00.317275+0000","last_became_peered":"2023-08-31T00:27:00.317275+0000","last_unstale":"2023-08-31T00:27:00.320422+0000","last_undegraded":"2023-08-31T00:27:00.320422+0000","last_fullsized":"2023-08-31T00:27:00.320422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:09:07.966465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338624+0000","last_change":"2023-08-31T00:26:59.310802+0000","last_active":"2023-08-31T00:27:00.338624+0000","last_peered":"2023-08-31T00:27:00.338624+0000","last_clean":"2023-08-31T00:27:00.338624+0000","last_became_active":"2023-08-31T00:26:59.310150+0000","last_became_peered":"2023-08-31T00:26:59.310150+0000","last_unstale":"2023-08-31T00:27:00.338624+0000","last_undegraded":"2023-08-31T00:27:00.338624+0000","last_fullsized":"2023-08-31T00:27:00.338624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326587+0000","last_change":"2023-08-31T00:27:00.324514+0000","last_active":"2023-08-31T00:27:00.326587+0000","last_peered":"2023-08-31T00:27:00.326587+0000","last_clean":"2023-08-31T00:27:00.326587+0000","last_became_active":"2023-08-31T00:27:00.324137+0000","last_became_peered":"2023-08-31T00:27:00.324137+0000","last_unstale":"2023-08-31T00:27:00.326587+0000","last_undegraded":"2023-08-31T00:27:00.326587+0000","last_fullsized":"2023-08-31T00:27:00.326587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.333647+0000","last_change":"2023-08-31T00:26:59.308265+0000","last_active":"2023-08-31T00:27:00.333647+0000","last_peered":"2023-08-31T00:27:00.333647+0000","last_clean":"2023-08-31T00:27:00.333647+0000","last_became_active":"2023-08-31T00:26:59.307956+0000","last_became_peered":"2023-08-31T00:26:59.307956+0000","last_unstale":"2023-08-31T00:27:00.333647+0000","last_undegraded":"2023-08-31T00:27:00.333647+0000","last_fullsized":"2023-08-31T00:27:00.333647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323516+0000","last_change":"2023-08-31T00:27:00.314782+0000","last_active":"2023-08-31T00:27:00.323516+0000","last_peered":"2023-08-31T00:27:00.323516+0000","last_clean":"2023-08-31T00:27:00.323516+0000","last_became_active":"2023-08-31T00:27:00.314505+0000","last_became_peered":"2023-08-31T00:27:00.314505+0000","last_unstale":"2023-08-31T00:27:00.323516+0000","last_undegraded":"2023-08-31T00:27:00.323516+0000","last_fullsized":"2023-08-31T00:27:00.323516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318391+0000","last_change":"2023-08-31T00:26:59.320415+0000","last_active":"2023-08-31T00:27:00.318391+0000","last_peered":"2023-08-31T00:27:00.318391+0000","last_clean":"2023-08-31T00:27:00.318391+0000","last_became_active":"2023-08-31T00:26:59.319939+0000","last_became_peered":"2023-08-31T00:26:59.319939+0000","last_unstale":"2023-08-31T00:27:00.318391+0000","last_undegraded":"2023-08-31T00:27:00.318391+0000","last_fullsized":"2023-08-31T00:27:00.318391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:08.276952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318468+0000","last_change":"2023-08-31T00:27:00.316185+0000","last_active":"2023-08-31T00:27:00.318468+0000","last_peered":"2023-08-31T00:27:00.318468+0000","last_clean":"2023-08-31T00:27:00.318468+0000","last_became_active":"2023-08-31T00:27:00.315707+0000","last_became_peered":"2023-08-31T00:27:00.315707+0000","last_unstale":"2023-08-31T00:27:00.318468+0000","last_undegraded":"2023-08-31T00:27:00.318468+0000","last_fullsized":"2023-08-31T00:27:00.318468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300453+0000","last_change":"2023-08-31T00:26:59.313185+0000","last_active":"2023-08-31T00:27:00.300453+0000","last_peered":"2023-08-31T00:27:00.300453+0000","last_clean":"2023-08-31T00:27:00.300453+0000","last_became_active":"2023-08-31T00:26:59.312883+0000","last_became_peered":"2023-08-31T00:26:59.312883+0000","last_unstale":"2023-08-31T00:27:00.300453+0000","last_undegraded":"2023-08-31T00:27:00.300453+0000","last_fullsized":"2023-08-31T00:27:00.300453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311434+0000","last_change":"2023-08-31T00:27:00.307379+0000","last_active":"2023-08-31T00:27:00.311434+0000","last_peered":"2023-08-31T00:27:00.311434+0000","last_clean":"2023-08-31T00:27:00.311434+0000","last_became_active":"2023-08-31T00:27:00.307055+0000","last_became_peered":"2023-08-31T00:27:00.307055+0000","last_unstale":"2023-08-31T00:27:00.311434+0000","last_undegraded":"2023-08-31T00:27:00.311434+0000","last_fullsized":"2023-08-31T00:27:00.311434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:47.503739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330723+0000","last_change":"2023-08-31T00:26:59.312847+0000","last_active":"2023-08-31T00:27:00.330723+0000","last_peered":"2023-08-31T00:27:00.330723+0000","last_clean":"2023-08-31T00:27:00.330723+0000","last_became_active":"2023-08-31T00:26:59.312546+0000","last_became_peered":"2023-08-31T00:26:59.312546+0000","last_unstale":"2023-08-31T00:27:00.330723+0000","last_undegraded":"2023-08-31T00:27:00.330723+0000","last_fullsized":"2023-08-31T00:27:00.330723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.315909+0000","last_change":"2023-08-31T00:27:00.314713+0000","last_active":"2023-08-31T00:27:00.315909+0000","last_peered":"2023-08-31T00:27:00.315909+0000","last_clean":"2023-08-31T00:27:00.315909+0000","last_became_active":"2023-08-31T00:27:00.314421+0000","last_became_peered":"2023-08-31T00:27:00.314421+0000","last_unstale":"2023-08-31T00:27:00.315909+0000","last_undegraded":"2023-08-31T00:27:00.315909+0000","last_fullsized":"2023-08-31T00:27:00.315909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.331388+0000","last_change":"2023-08-31T00:26:59.315973+0000","last_active":"2023-08-31T00:27:00.331388+0000","last_peered":"2023-08-31T00:27:00.331388+0000","last_clean":"2023-08-31T00:27:00.331388+0000","last_became_active":"2023-08-31T00:26:59.315513+0000","last_became_peered":"2023-08-31T00:26:59.315513+0000","last_unstale":"2023-08-31T00:27:00.331388+0000","last_undegraded":"2023-08-31T00:27:00.331388+0000","last_fullsized":"2023-08-31T00:27:00.331388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.315960+0000","last_change":"2023-08-31T00:27:00.314705+0000","last_active":"2023-08-31T00:27:00.315960+0000","last_peered":"2023-08-31T00:27:00.315960+0000","last_clean":"2023-08-31T00:27:00.315960+0000","last_became_active":"2023-08-31T00:27:00.314428+0000","last_became_peered":"2023-08-31T00:27:00.314428+0000","last_unstale":"2023-08-31T00:27:00.315960+0000","last_undegraded":"2023-08-31T00:27:00.315960+0000","last_fullsized":"2023-08-31T00:27:00.315960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.312547+0000","last_change":"2023-08-31T00:26:59.311823+0000","last_active":"2023-08-31T00:27:00.312547+0000","last_peered":"2023-08-31T00:27:00.312547+0000","last_clean":"2023-08-31T00:27:00.312547+0000","last_became_active":"2023-08-31T00:26:59.311483+0000","last_became_peered":"2023-08-31T00:26:59.311483+0000","last_unstale":"2023-08-31T00:27:00.312547+0000","last_undegraded":"2023-08-31T00:27:00.312547+0000","last_fullsized":"2023-08-31T00:27:00.312547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327115+0000","last_change":"2023-08-31T00:27:00.325548+0000","last_active":"2023-08-31T00:27:00.327115+0000","last_peered":"2023-08-31T00:27:00.327115+0000","last_clean":"2023-08-31T00:27:00.327115+0000","last_became_active":"2023-08-31T00:27:00.325055+0000","last_became_peered":"2023-08-31T00:27:00.325055+0000","last_unstale":"2023-08-31T00:27:00.327115+0000","last_undegraded":"2023-08-31T00:27:00.327115+0000","last_fullsized":"2023-08-31T00:27:00.327115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.318250+0000","last_change":"2023-08-31T00:26:59.318639+0000","last_active":"2023-08-31T00:27:00.318250+0000","last_peered":"2023-08-31T00:27:00.318250+0000","last_clean":"2023-08-31T00:27:00.318250+0000","last_became_active":"2023-08-31T00:26:59.318291+0000","last_became_peered":"2023-08-31T00:26:59.318291+0000","last_unstale":"2023-08-31T00:27:00.318250+0000","last_undegraded":"2023-08-31T00:27:00.318250+0000","last_fullsized":"2023-08-31T00:27:00.318250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329570+0000","last_change":"2023-08-31T00:27:00.328847+0000","last_active":"2023-08-31T00:27:00.329570+0000","last_peered":"2023-08-31T00:27:00.329570+0000","last_clean":"2023-08-31T00:27:00.329570+0000","last_became_active":"2023-08-31T00:27:00.328588+0000","last_became_peered":"2023-08-31T00:27:00.328588+0000","last_unstale":"2023-08-31T00:27:00.329570+0000","last_undegraded":"2023-08-31T00:27:00.329570+0000","last_fullsized":"2023-08-31T00:27:00.329570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323635+0000","last_change":"2023-08-31T00:27:00.319649+0000","last_active":"2023-08-31T00:27:00.323635+0000","last_peered":"2023-08-31T00:27:00.323635+0000","last_clean":"2023-08-31T00:27:00.323635+0000","last_became_active":"2023-08-31T00:27:00.319365+0000","last_became_peered":"2023-08-31T00:27:00.319365+0000","last_unstale":"2023-08-31T00:27:00.323635+0000","last_undegraded":"2023-08-31T00:27:00.323635+0000","last_fullsized":"2023-08-31T00:27:00.323635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300546+0000","last_change":"2023-08-31T00:26:59.314564+0000","last_active":"2023-08-31T00:27:00.300546+0000","last_peered":"2023-08-31T00:27:00.300546+0000","last_clean":"2023-08-31T00:27:00.300546+0000","last_became_active":"2023-08-31T00:26:59.314296+0000","last_became_peered":"2023-08-31T00:26:59.314296+0000","last_unstale":"2023-08-31T00:27:00.300546+0000","last_undegraded":"2023-08-31T00:27:00.300546+0000","last_fullsized":"2023-08-31T00:27:00.300546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:06.610718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334899+0000","last_change":"2023-08-31T00:27:00.329442+0000","last_active":"2023-08-31T00:27:00.334899+0000","last_peered":"2023-08-31T00:27:00.334899+0000","last_clean":"2023-08-31T00:27:00.334899+0000","last_became_active":"2023-08-31T00:27:00.329237+0000","last_became_peered":"2023-08-31T00:27:00.329237+0000","last_unstale":"2023-08-31T00:27:00.334899+0000","last_undegraded":"2023-08-31T00:27:00.334899+0000","last_fullsized":"2023-08-31T00:27:00.334899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.317359+0000","last_change":"2023-08-31T00:26:59.314864+0000","last_active":"2023-08-31T00:27:00.317359+0000","last_peered":"2023-08-31T00:27:00.317359+0000","last_clean":"2023-08-31T00:27:00.317359+0000","last_became_active":"2023-08-31T00:26:59.313879+0000","last_became_peered":"2023-08-31T00:26:59.313879+0000","last_unstale":"2023-08-31T00:27:00.317359+0000","last_undegraded":"2023-08-31T00:27:00.317359+0000","last_fullsized":"2023-08-31T00:27:00.317359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:53.782002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-08-31T00:26:59.315509+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:26:59.315509+0000","last_peered":"2023-08-31T00:26:59.315509+0000","last_clean":"2023-08-31T00:26:59.315509+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:26:59.315509+0000","last_undegraded":"2023-08-31T00:26:59.315509+0000","last_fullsized":"2023-08-31T00:26:59.315509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323487+0000","last_change":"2023-08-31T00:27:00.315831+0000","last_active":"2023-08-31T00:27:00.323487+0000","last_peered":"2023-08-31T00:27:00.323487+0000","last_clean":"2023-08-31T00:27:00.323487+0000","last_became_active":"2023-08-31T00:27:00.315547+0000","last_became_peered":"2023-08-31T00:27:00.315547+0000","last_unstale":"2023-08-31T00:27:00.323487+0000","last_undegraded":"2023-08-31T00:27:00.323487+0000","last_fullsized":"2023-08-31T00:27:00.323487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:47.503739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.305093+0000","last_change":"2023-08-31T00:26:59.323394+0000","last_active":"2023-08-31T00:27:00.305093+0000","last_peered":"2023-08-31T00:27:00.305093+0000","last_clean":"2023-08-31T00:27:00.305093+0000","last_became_active":"2023-08-31T00:26:59.323150+0000","last_became_peered":"2023-08-31T00:26:59.323150+0000","last_unstale":"2023-08-31T00:27:00.305093+0000","last_undegraded":"2023-08-31T00:27:00.305093+0000","last_fullsized":"2023-08-31T00:27:00.305093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.305869+0000","last_change":"2023-08-31T00:26:59.323065+0000","last_active":"2023-08-31T00:27:00.305869+0000","last_peered":"2023-08-31T00:27:00.305869+0000","last_clean":"2023-08-31T00:27:00.305869+0000","last_became_active":"2023-08-31T00:26:59.322673+0000","last_became_peered":"2023-08-31T00:26:59.322673+0000","last_unstale":"2023-08-31T00:27:00.305869+0000","last_undegraded":"2023-08-31T00:27:00.305869+0000","last_fullsized":"2023-08-31T00:27:00.305869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.327623+0000","last_change":"2023-08-31T00:27:00.319918+0000","last_active":"2023-08-31T00:27:00.327623+0000","last_peered":"2023-08-31T00:27:00.327623+0000","last_clean":"2023-08-31T00:27:00.327623+0000","last_became_active":"2023-08-31T00:27:00.319656+0000","last_became_peered":"2023-08-31T00:27:00.319656+0000","last_unstale":"2023-08-31T00:27:00.327623+0000","last_undegraded":"2023-08-31T00:27:00.327623+0000","last_fullsized":"2023-08-31T00:27:00.327623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.310353+0000","last_change":"2023-08-31T00:26:59.316728+0000","last_active":"2023-08-31T00:27:00.310353+0000","last_peered":"2023-08-31T00:27:00.310353+0000","last_clean":"2023-08-31T00:27:00.310353+0000","last_became_active":"2023-08-31T00:26:59.316325+0000","last_became_peered":"2023-08-31T00:26:59.316325+0000","last_unstale":"2023-08-31T00:27:00.310353+0000","last_undegraded":"2023-08-31T00:27:00.310353+0000","last_fullsized":"2023-08-31T00:27:00.310353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323478+0000","last_change":"2023-08-31T00:27:00.317323+0000","last_active":"2023-08-31T00:27:00.323478+0000","last_peered":"2023-08-31T00:27:00.323478+0000","last_clean":"2023-08-31T00:27:00.323478+0000","last_became_active":"2023-08-31T00:27:00.317051+0000","last_became_peered":"2023-08-31T00:27:00.317051+0000","last_unstale":"2023-08-31T00:27:00.323478+0000","last_undegraded":"2023-08-31T00:27:00.323478+0000","last_fullsized":"2023-08-31T00:27:00.323478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329234+0000","last_change":"2023-08-31T00:26:59.319291+0000","last_active":"2023-08-31T00:27:00.329234+0000","last_peered":"2023-08-31T00:27:00.329234+0000","last_clean":"2023-08-31T00:27:00.329234+0000","last_became_active":"2023-08-31T00:26:59.318911+0000","last_became_peered":"2023-08-31T00:26:59.318911+0000","last_unstale":"2023-08-31T00:27:00.329234+0000","last_undegraded":"2023-08-31T00:27:00.329234+0000","last_fullsized":"2023-08-31T00:27:00.329234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323397+0000","last_change":"2023-08-31T00:27:00.315232+0000","last_active":"2023-08-31T00:27:00.323397+0000","last_peered":"2023-08-31T00:27:00.323397+0000","last_clean":"2023-08-31T00:27:00.323397+0000","last_became_active":"2023-08-31T00:27:00.314924+0000","last_became_peered":"2023-08-31T00:27:00.314924+0000","last_unstale":"2023-08-31T00:27:00.323397+0000","last_undegraded":"2023-08-31T00:27:00.323397+0000","last_fullsized":"2023-08-31T00:27:00.323397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.304780+0000","last_change":"2023-08-31T00:26:59.322925+0000","last_active":"2023-08-31T00:27:00.304780+0000","last_peered":"2023-08-31T00:27:00.304780+0000","last_clean":"2023-08-31T00:27:00.304780+0000","last_became_active":"2023-08-31T00:26:59.322585+0000","last_became_peered":"2023-08-31T00:26:59.322585+0000","last_unstale":"2023-08-31T00:27:00.304780+0000","last_undegraded":"2023-08-31T00:27:00.304780+0000","last_fullsized":"2023-08-31T00:27:00.304780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.319519+0000","last_change":"2023-08-31T00:27:00.312503+0000","last_active":"2023-08-31T00:27:00.319519+0000","last_peered":"2023-08-31T00:27:00.319519+0000","last_clean":"2023-08-31T00:27:00.319519+0000","last_became_active":"2023-08-31T00:27:00.312047+0000","last_became_peered":"2023-08-31T00:27:00.312047+0000","last_unstale":"2023-08-31T00:27:00.319519+0000","last_undegraded":"2023-08-31T00:27:00.319519+0000","last_fullsized":"2023-08-31T00:27:00.319519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:30:24.334269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311327+0000","last_change":"2023-08-31T00:26:59.317022+0000","last_active":"2023-08-31T00:27:00.311327+0000","last_peered":"2023-08-31T00:27:00.311327+0000","last_clean":"2023-08-31T00:27:00.311327+0000","last_became_active":"2023-08-31T00:26:59.316703+0000","last_became_peered":"2023-08-31T00:26:59.316703+0000","last_unstale":"2023-08-31T00:27:00.311327+0000","last_undegraded":"2023-08-31T00:27:00.311327+0000","last_fullsized":"2023-08-31T00:27:00.311327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.323786+0000","last_change":"2023-08-31T00:27:00.317829+0000","last_active":"2023-08-31T00:27:00.323786+0000","last_peered":"2023-08-31T00:27:00.323786+0000","last_clean":"2023-08-31T00:27:00.323786+0000","last_became_active":"2023-08-31T00:27:00.317552+0000","last_became_peered":"2023-08-31T00:27:00.317552+0000","last_unstale":"2023-08-31T00:27:00.323786+0000","last_undegraded":"2023-08-31T00:27:00.323786+0000","last_fullsized":"2023-08-31T00:27:00.323786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.309543+0000","last_change":"2023-08-31T00:26:59.310991+0000","last_active":"2023-08-31T00:27:00.309543+0000","last_peered":"2023-08-31T00:27:00.309543+0000","last_clean":"2023-08-31T00:27:00.309543+0000","last_became_active":"2023-08-31T00:26:59.310696+0000","last_became_peered":"2023-08-31T00:26:59.310696+0000","last_unstale":"2023-08-31T00:27:00.309543+0000","last_undegraded":"2023-08-31T00:27:00.309543+0000","last_fullsized":"2023-08-31T00:27:00.309543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334933+0000","last_change":"2023-08-31T00:27:00.329128+0000","last_active":"2023-08-31T00:27:00.334933+0000","last_peered":"2023-08-31T00:27:00.334933+0000","last_clean":"2023-08-31T00:27:00.334933+0000","last_became_active":"2023-08-31T00:27:00.328627+0000","last_became_peered":"2023-08-31T00:27:00.328627+0000","last_unstale":"2023-08-31T00:27:00.334933+0000","last_undegraded":"2023-08-31T00:27:00.334933+0000","last_fullsized":"2023-08-31T00:27:00.334933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329309+0000","last_change":"2023-08-31T00:26:59.325883+0000","last_active":"2023-08-31T00:27:00.329309+0000","last_peered":"2023-08-31T00:27:00.329309+0000","last_clean":"2023-08-31T00:27:00.329309+0000","last_became_active":"2023-08-31T00:26:59.325639+0000","last_became_peered":"2023-08-31T00:26:59.325639+0000","last_unstale":"2023-08-31T00:27:00.329309+0000","last_undegraded":"2023-08-31T00:27:00.329309+0000","last_fullsized":"2023-08-31T00:27:00.329309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:33.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.312866+0000","last_change":"2023-08-31T00:27:00.312122+0000","last_active":"2023-08-31T00:27:00.312866+0000","last_peered":"2023-08-31T00:27:00.312866+0000","last_clean":"2023-08-31T00:27:00.312866+0000","last_became_active":"2023-08-31T00:27:00.311829+0000","last_became_peered":"2023-08-31T00:27:00.311829+0000","last_unstale":"2023-08-31T00:27:00.312866+0000","last_undegraded":"2023-08-31T00:27:00.312866+0000","last_fullsized":"2023-08-31T00:27:00.312866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.300621+0000","last_change":"2023-08-31T00:26:59.321055+0000","last_active":"2023-08-31T00:27:00.300621+0000","last_peered":"2023-08-31T00:27:00.300621+0000","last_clean":"2023-08-31T00:27:00.300621+0000","last_became_active":"2023-08-31T00:26:59.320790+0000","last_became_peered":"2023-08-31T00:26:59.320790+0000","last_unstale":"2023-08-31T00:27:00.300621+0000","last_undegraded":"2023-08-31T00:27:00.300621+0000","last_fullsized":"2023-08-31T00:27:00.300621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.326606+0000","last_change":"2023-08-31T00:27:00.325496+0000","last_active":"2023-08-31T00:27:00.326606+0000","last_peered":"2023-08-31T00:27:00.326606+0000","last_clean":"2023-08-31T00:27:00.326606+0000","last_became_active":"2023-08-31T00:27:00.325207+0000","last_became_peered":"2023-08-31T00:27:00.325207+0000","last_unstale":"2023-08-31T00:27:00.326606+0000","last_undegraded":"2023-08-31T00:27:00.326606+0000","last_fullsized":"2023-08-31T00:27:00.326606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330442+0000","last_change":"2023-08-31T00:26:59.311899+0000","last_active":"2023-08-31T00:27:00.330442+0000","last_peered":"2023-08-31T00:27:00.330442+0000","last_clean":"2023-08-31T00:27:00.330442+0000","last_became_active":"2023-08-31T00:26:59.311612+0000","last_became_peered":"2023-08-31T00:26:59.311612+0000","last_unstale":"2023-08-31T00:27:00.330442+0000","last_undegraded":"2023-08-31T00:27:00.330442+0000","last_fullsized":"2023-08-31T00:27:00.330442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338562+0000","last_change":"2023-08-31T00:27:00.334889+0000","last_active":"2023-08-31T00:27:00.338562+0000","last_peered":"2023-08-31T00:27:00.338562+0000","last_clean":"2023-08-31T00:27:00.338562+0000","last_became_active":"2023-08-31T00:27:00.334672+0000","last_became_peered":"2023-08-31T00:27:00.334672+0000","last_unstale":"2023-08-31T00:27:00.338562+0000","last_undegraded":"2023-08-31T00:27:00.338562+0000","last_fullsized":"2023-08-31T00:27:00.338562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.335058+0000","last_change":"2023-08-31T00:26:59.311633+0000","last_active":"2023-08-31T00:27:00.335058+0000","last_peered":"2023-08-31T00:27:00.335058+0000","last_clean":"2023-08-31T00:27:00.335058+0000","last_became_active":"2023-08-31T00:26:59.311354+0000","last_became_peered":"2023-08-31T00:26:59.311354+0000","last_unstale":"2023-08-31T00:27:00.335058+0000","last_undegraded":"2023-08-31T00:27:00.335058+0000","last_fullsized":"2023-08-31T00:27:00.335058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.320682+0000","last_change":"2023-08-31T00:27:00.318313+0000","last_active":"2023-08-31T00:27:00.320682+0000","last_peered":"2023-08-31T00:27:00.320682+0000","last_clean":"2023-08-31T00:27:00.320682+0000","last_became_active":"2023-08-31T00:27:00.318100+0000","last_became_peered":"2023-08-31T00:27:00.318100+0000","last_unstale":"2023-08-31T00:27:00.320682+0000","last_undegraded":"2023-08-31T00:27:00.320682+0000","last_fullsized":"2023-08-31T00:27:00.320682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.311454+0000","last_change":"2023-08-31T00:27:00.307564+0000","last_active":"2023-08-31T00:27:00.311454+0000","last_peered":"2023-08-31T00:27:00.311454+0000","last_clean":"2023-08-31T00:27:00.311454+0000","last_became_active":"2023-08-31T00:27:00.307264+0000","last_became_peered":"2023-08-31T00:27:00.307264+0000","last_unstale":"2023-08-31T00:27:00.311454+0000","last_undegraded":"2023-08-31T00:27:00.311454+0000","last_fullsized":"2023-08-31T00:27:00.311454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:56:31.080364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.329218+0000","last_change":"2023-08-31T00:27:00.322552+0000","last_active":"2023-08-31T00:27:00.329218+0000","last_peered":"2023-08-31T00:27:00.329218+0000","last_clean":"2023-08-31T00:27:00.329218+0000","last_became_active":"2023-08-31T00:27:00.322254+0000","last_became_peered":"2023-08-31T00:27:00.322254+0000","last_unstale":"2023-08-31T00:27:00.329218+0000","last_undegraded":"2023-08-31T00:27:00.329218+0000","last_fullsized":"2023-08-31T00:27:00.329218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.338575+0000","last_change":"2023-08-31T00:27:00.334929+0000","last_active":"2023-08-31T00:27:00.338575+0000","last_peered":"2023-08-31T00:27:00.338575+0000","last_clean":"2023-08-31T00:27:00.338575+0000","last_became_active":"2023-08-31T00:27:00.334671+0000","last_became_peered":"2023-08-31T00:27:00.334671+0000","last_unstale":"2023-08-31T00:27:00.338575+0000","last_undegraded":"2023-08-31T00:27:00.338575+0000","last_fullsized":"2023-08-31T00:27:00.338575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:17:43.595315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.331038+0000","last_change":"2023-08-31T00:27:00.327878+0000","last_active":"2023-08-31T00:27:00.331038+0000","last_peered":"2023-08-31T00:27:00.331038+0000","last_clean":"2023-08-31T00:27:00.331038+0000","last_became_active":"2023-08-31T00:27:00.327570+0000","last_became_peered":"2023-08-31T00:27:00.327570+0000","last_unstale":"2023-08-31T00:27:00.331038+0000","last_undegraded":"2023-08-31T00:27:00.331038+0000","last_fullsized":"2023-08-31T00:27:00.331038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334427+0000","last_change":"2023-08-31T00:27:00.321837+0000","last_active":"2023-08-31T00:27:00.334427+0000","last_peered":"2023-08-31T00:27:00.334427+0000","last_clean":"2023-08-31T00:27:00.334427+0000","last_became_active":"2023-08-31T00:27:00.321561+0000","last_became_peered":"2023-08-31T00:27:00.321561+0000","last_unstale":"2023-08-31T00:27:00.334427+0000","last_undegraded":"2023-08-31T00:27:00.334427+0000","last_fullsized":"2023-08-31T00:27:00.334427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.328523+0000","last_change":"2023-08-31T00:27:00.322796+0000","last_active":"2023-08-31T00:27:00.328523+0000","last_peered":"2023-08-31T00:27:00.328523+0000","last_clean":"2023-08-31T00:27:00.328523+0000","last_became_active":"2023-08-31T00:27:00.322507+0000","last_became_peered":"2023-08-31T00:27:00.322507+0000","last_unstale":"2023-08-31T00:27:00.328523+0000","last_undegraded":"2023-08-31T00:27:00.328523+0000","last_fullsized":"2023-08-31T00:27:00.328523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.313415+0000","last_change":"2023-08-31T00:27:00.311231+0000","last_active":"2023-08-31T00:27:00.313415+0000","last_peered":"2023-08-31T00:27:00.313415+0000","last_clean":"2023-08-31T00:27:00.313415+0000","last_became_active":"2023-08-31T00:27:00.310948+0000","last_became_peered":"2023-08-31T00:27:00.310948+0000","last_unstale":"2023-08-31T00:27:00.313415+0000","last_undegraded":"2023-08-31T00:27:00.313415+0000","last_fullsized":"2023-08-31T00:27:00.313415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:13.504083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334324+0000","last_change":"2023-08-31T00:27:00.321793+0000","last_active":"2023-08-31T00:27:00.334324+0000","last_peered":"2023-08-31T00:27:00.334324+0000","last_clean":"2023-08-31T00:27:00.334324+0000","last_became_active":"2023-08-31T00:27:00.321498+0000","last_became_peered":"2023-08-31T00:27:00.321498+0000","last_unstale":"2023-08-31T00:27:00.334324+0000","last_undegraded":"2023-08-31T00:27:00.334324+0000","last_fullsized":"2023-08-31T00:27:00.334324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330344+0000","last_change":"2023-08-31T00:27:00.327048+0000","last_active":"2023-08-31T00:27:00.330344+0000","last_peered":"2023-08-31T00:27:00.330344+0000","last_clean":"2023-08-31T00:27:00.330344+0000","last_became_active":"2023-08-31T00:27:00.326522+0000","last_became_peered":"2023-08-31T00:27:00.326522+0000","last_unstale":"2023-08-31T00:27:00.330344+0000","last_undegraded":"2023-08-31T00:27:00.330344+0000","last_fullsized":"2023-08-31T00:27:00.330344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:03.476833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.334366+0000","last_change":"2023-08-31T00:27:00.322224+0000","last_active":"2023-08-31T00:27:00.334366+0000","last_peered":"2023-08-31T00:27:00.334366+0000","last_clean":"2023-08-31T00:27:00.334366+0000","last_became_active":"2023-08-31T00:27:00.321978+0000","last_became_peered":"2023-08-31T00:27:00.321978+0000","last_unstale":"2023-08-31T00:27:00.334366+0000","last_undegraded":"2023-08-31T00:27:00.334366+0000","last_fullsized":"2023-08-31T00:27:00.334366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.330442+0000","last_change":"2023-08-31T00:27:00.327229+0000","last_active":"2023-08-31T00:27:00.330442+0000","last_peered":"2023-08-31T00:27:00.330442+0000","last_clean":"2023-08-31T00:27:00.330442+0000","last_became_active":"2023-08-31T00:27:00.326932+0000","last_became_peered":"2023-08-31T00:27:00.326932+0000","last_unstale":"2023-08-31T00:27:00.330442+0000","last_undegraded":"2023-08-31T00:27:00.330442+0000","last_fullsized":"2023-08-31T00:27:00.330442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.319001+0000","last_change":"2023-08-31T00:27:00.313686+0000","last_active":"2023-08-31T00:27:00.319001+0000","last_peered":"2023-08-31T00:27:00.319001+0000","last_clean":"2023-08-31T00:27:00.319001+0000","last_became_active":"2023-08-31T00:27:00.313386+0000","last_became_peered":"2023-08-31T00:27:00.313386+0000","last_unstale":"2023-08-31T00:27:00.319001+0000","last_undegraded":"2023-08-31T00:27:00.319001+0000","last_fullsized":"2023-08-31T00:27:00.319001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:30:24.334269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.319219+0000","last_change":"2023-08-31T00:27:00.316315+0000","last_active":"2023-08-31T00:27:00.319219+0000","last_peered":"2023-08-31T00:27:00.319219+0000","last_clean":"2023-08-31T00:27:00.319219+0000","last_became_active":"2023-08-31T00:27:00.313982+0000","last_became_peered":"2023-08-31T00:27:00.313982+0000","last_unstale":"2023-08-31T00:27:00.319219+0000","last_undegraded":"2023-08-31T00:27:00.319219+0000","last_fullsized":"2023-08-31T00:27:00.319219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:07.619561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":648191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9079999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5630000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2130000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.524}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3730000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":64598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:27:04.790 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T00:27:04.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-08-31T00:27:04.792 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-31T00:27:04.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 -- 172.21.15.77:0/946894508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4005330 msgr2=0x7fe7b400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/946894508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4005330 0x7fe7b400ba10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000e320 tx=0x7fe7b4005880 comp rx=0 tx=0).stop 2023-08-31T00:27:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 -- 172.21.15.77:0/946894508 shutdown_connections 2023-08-31T00:27:04.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/946894508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b4005330 0x7fe7b400ba10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 -- 172.21.15.77:0/946894508 >> 172.21.15.77:0/946894508 conn(0x7fe7c80cf180 msgr2=0x7fe7c80cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 -- 172.21.15.77:0/946894508 shutdown_connections 2023-08-31T00:27:04.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.948+0000 7fe7d00a0700 1 -- 172.21.15.77:0/946894508 wait complete. 2023-08-31T00:27:04.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.949+0000 7fe7d00a0700 1 Processor -- start 2023-08-31T00:27:04.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.949+0000 7fe7d00a0700 1 -- start start 2023-08-31T00:27:04.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7d00a0700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7b4005330 0x7fe7c80c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7d00a0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 0x7fe7c81f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7d00a0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7c80c6be0 0x7fe7c80c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7d00a0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c6250 con 0x7fe7c8146fb0 2023-08-31T00:27:04.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7d00a0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c75d0 con 0x7fe7c80c6be0 2023-08-31T00:27:04.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7d00a0700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c815c380 con 0x7fe7b4005330 2023-08-31T00:27:04.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 0x7fe7c81f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 0x7fe7c81f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38470/0 (socket says 172.21.15.77:38470) 2023-08-31T00:27:04.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 -- 172.21.15.77:0/3296884555 learned_addr learned my addr 172.21.15.77:0/3296884555 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:04.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7ce63d700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7c80c6be0 0x7fe7c80c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 -- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7b4005330 msgr2=0x7fe7c80c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7b4005330 0x7fe7c80c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 -- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7c80c6be0 msgr2=0x7fe7c80c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:04.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7c80c6be0 0x7fe7c80c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:04.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.950+0000 7fe7cd63b700 1 -- 172.21.15.77:0/3296884555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80c6430 con 0x7fe7c8146fb0 2023-08-31T00:27:04.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.951+0000 7fe7cd63b700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 0x7fe7c81f24b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4004dd0 tx=0x7fe7c4001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:04.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.951+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4011660 con 0x7fe7c8146fb0 2023-08-31T00:27:04.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.951+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe7c40118d0 con 0x7fe7c8146fb0 2023-08-31T00:27:04.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.951+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80c6710 con 0x7fe7c8146fb0 2023-08-31T00:27:04.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.951+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4011ce0 con 0x7fe7c8146fb0 2023-08-31T00:27:04.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.951+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c81f29f0 con 0x7fe7c8146fb0 2023-08-31T00:27:04.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.952+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c8073c30 con 0x7fe7c8146fb0 2023-08-31T00:27:04.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.952+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe7c401b460 con 0x7fe7c8146fb0 2023-08-31T00:27:04.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.953+0000 7fe7be7fc700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe7ac06a0e0 0x7fe7ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:04.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.953+0000 7fe7cde3c700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe7ac06a0e0 0x7fe7ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:04.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.953+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7c4088ca0 con 0x7fe7c8146fb0 2023-08-31T00:27:04.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.953+0000 7fe7cde3c700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe7ac06a0e0 0x7fe7ac06c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8001ce0 tx=0x7fe7b8001b90 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:04.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:04.957+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe7c4054470 con 0x7fe7c8146fb0 2023-08-31T00:27:05.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.148+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7fe7c80cff90 con 0x7fe7c8146fb0 2023-08-31T00:27:05.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.149+0000 7fe7be7fc700 1 -- 172.21.15.77:0/3296884555 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7fe7c4057a90 con 0x7fe7c8146fb0 2023-08-31T00:27:05.150 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:05.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe7ac06a0e0 msgr2=0x7fe7ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe7ac06a0e0 0x7fe7ac06c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8001ce0 tx=0x7fe7b8001b90 comp rx=0 tx=0).stop 2023-08-31T00:27:05.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 msgr2=0x7fe7c81f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 0x7fe7c81f24b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4004dd0 tx=0x7fe7c4001540 comp rx=0 tx=0).stop 2023-08-31T00:27:05.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 shutdown_connections 2023-08-31T00:27:05.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe7ac06a0e0 0x7fe7ac06c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe7b4005330 0x7fe7c80c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7c80c6be0 0x7fe7c80c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 --2- 172.21.15.77:0/3296884555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7c8146fb0 0x7fe7c81f24b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 >> 172.21.15.77:0/3296884555 conn(0x7fe7c80cf180 msgr2=0x7fe7c8153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:05.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 shutdown_connections 2023-08-31T00:27:05.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.151+0000 7fe7d00a0700 1 -- 172.21.15.77:0/3296884555 wait complete. 2023-08-31T00:27:05.163 INFO:teuthology.orchestra.run.smithi077.stdout:[{"version":30,"timestamp":"2023-08-31T00:26:45.205085+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6238.506254"}]}] 2023-08-31T00:27:05.164 INFO:tasks.ceph_manager:config epoch is 30 2023-08-31T00:27:05.164 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-31T00:27:05.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-31T00:27:05.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-31T00:27:05.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 -- 172.21.15.77:0/2132987836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0b06a0 msgr2=0x7fa32c06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 --2- 172.21.15.77:0/2132987836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0b06a0 0x7fa32c06ab20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa32c06b700 tx=0x7fa328009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:05.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 -- 172.21.15.77:0/2132987836 shutdown_connections 2023-08-31T00:27:05.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 --2- 172.21.15.77:0/2132987836 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa32c0b0b00 0x7fa32c06b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 --2- 172.21.15.77:0/2132987836 >> v2:172.21.15.139:3300/0 conn(0x7fa32c0ace10 0x7fa32c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 --2- 172.21.15.77:0/2132987836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0b06a0 0x7fa32c06ab20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 -- 172.21.15.77:0/2132987836 >> 172.21.15.77:0/2132987836 conn(0x7fa32c070270 msgr2=0x7fa32c070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:05.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 -- 172.21.15.77:0/2132987836 shutdown_connections 2023-08-31T00:27:05.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.287+0000 7fa33470e700 1 -- 172.21.15.77:0/2132987836 wait complete. 2023-08-31T00:27:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.288+0000 7fa33470e700 1 Processor -- start 2023-08-31T00:27:05.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.288+0000 7fa33470e700 1 -- start start 2023-08-31T00:27:05.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 0x7fa32c155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa32c0b06a0 0x7fa32c0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa32c0b0b00 0x7fa32c15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c4630 con 0x7fa32c0ace10 2023-08-31T00:27:05.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c1170 con 0x7fa32c0b0b00 2023-08-31T00:27:05.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c156420 con 0x7fa32c0b06a0 2023-08-31T00:27:05.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 0x7fa32c155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 0x7fa32c155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38480/0 (socket says 172.21.15.77:38480) 2023-08-31T00:27:05.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 -- 172.21.15.77:0/3179118018 learned_addr learned my addr 172.21.15.77:0/3179118018 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:05.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa331ca9700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa32c0b06a0 0x7fa32c0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa332cab700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa32c0b0b00 0x7fa32c15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 -- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa32c0b06a0 msgr2=0x7fa32c0c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa32c0b06a0 0x7fa32c0c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 -- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa32c0b0b00 msgr2=0x7fa32c15bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa32c0b0b00 0x7fa32c15bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 -- 172.21.15.77:0/3179118018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280095f0 con 0x7fa32c0ace10 2023-08-31T00:27:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa3324aa700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 0x7fa32c155ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00d980 tx=0x7fa31c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c00f890 con 0x7fa32c0ace10 2023-08-31T00:27:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa31c00fae0 con 0x7fa32c0ace10 2023-08-31T00:27:05.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c0c7a80 con 0x7fa32c0ace10 2023-08-31T00:27:05.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c010460 con 0x7fa32c0ace10 2023-08-31T00:27:05.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.289+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c0c6fa0 con 0x7fa32c0ace10 2023-08-31T00:27:05.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.290+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c0c78d0 con 0x7fa32c0ace10 2023-08-31T00:27:05.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.291+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa31c0105c0 con 0x7fa32c0ace10 2023-08-31T00:27:05.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.291+0000 7fa322ffd700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa31006a0e0 0x7fa31006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.291+0000 7fa331ca9700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa31006a0e0 0x7fa31006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.291+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa31c0884a0 con 0x7fa32c0ace10 2023-08-31T00:27:05.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.291+0000 7fa331ca9700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa31006a0e0 0x7fa31006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3280098e0 tx=0x7fa3280047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:05.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.295+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa31c053d10 con 0x7fa32c0ace10 2023-08-31T00:27:05.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.544+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa32c073c30 con 0x7fa32c0ace10 2023-08-31T00:27:05.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.547+0000 7fa322ffd700 1 -- 172.21.15.77:0/3179118018 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169491 (secure 0 0 0) 0x7fa31c057330 con 0x7fa32c0ace10 2023-08-31T00:27:05.551 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:05.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa31006a0e0 msgr2=0x7fa31006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa31006a0e0 0x7fa31006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3280098e0 tx=0x7fa3280047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 msgr2=0x7fa32c155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 0x7fa32c155ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00d980 tx=0x7fa31c00dc90 comp rx=0 tx=0).stop 2023-08-31T00:27:05.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 shutdown_connections 2023-08-31T00:27:05.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa31006a0e0 0x7fa31006c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa32c0b0b00 0x7fa32c15bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa32c0ace10 0x7fa32c155ee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 --2- 172.21.15.77:0/3179118018 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa32c0b06a0 0x7fa32c0c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 >> 172.21.15.77:0/3179118018 conn(0x7fa32c070270 msgr2=0x7fa32c0ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:05.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 shutdown_connections 2023-08-31T00:27:05.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.550+0000 7fa33470e700 1 -- 172.21.15.77:0/3179118018 wait complete. 2023-08-31T00:27:05.562 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"active_gid":4209,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3314313596},{"type":"v1","addr":"172.21.15.77:6833","nonce":3314313596}]},"active_addr":"172.21.15.77:6833/3314313596","active_change":"2023-08-31T00:26:40.108123+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4174,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1478060132}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3819061926}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":233373215}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":3724716310}]}]} 2023-08-31T00:27:05.567 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-31T00:27:05.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-31T00:27:05.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:05.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 -- 172.21.15.77:0/1349392983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06580b04a0 msgr2=0x7f06580ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 --2- 172.21.15.77:0/1349392983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06580b04a0 0x7f06580ce2b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0640005fd0 tx=0x7f0640009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:05.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 -- 172.21.15.77:0/1349392983 shutdown_connections 2023-08-31T00:27:05.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 --2- 172.21.15.77:0/1349392983 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065815b3d0 0x7f06580cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 --2- 172.21.15.77:0/1349392983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06580b04a0 0x7f06580ce2b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 -- 172.21.15.77:0/1349392983 >> 172.21.15.77:0/1349392983 conn(0x7f0658071630 msgr2=0x7f0658071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:05.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 -- 172.21.15.77:0/1349392983 shutdown_connections 2023-08-31T00:27:05.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.688+0000 7f065ca13700 1 -- 172.21.15.77:0/1349392983 wait complete. 2023-08-31T00:27:05.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.690+0000 7f065ca13700 1 Processor -- start 2023-08-31T00:27:05.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.690+0000 7f065ca13700 1 -- start start 2023-08-31T00:27:05.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065ca13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06580b04a0 0x7f06581f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065ca13700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f06580ce7f0 0x7f06580cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065ca13700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 0x7f065814acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065ca13700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065814a8b0 con 0x7f065815b3d0 2023-08-31T00:27:05.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065ca13700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581f4ab0 con 0x7f06580b04a0 2023-08-31T00:27:05.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065ca13700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065814ea50 con 0x7f06580ce7f0 2023-08-31T00:27:05.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 0x7f065814acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 0x7f065814acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38496/0 (socket says 172.21.15.77:38496) 2023-08-31T00:27:05.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 -- 172.21.15.77:0/2477766774 learned_addr learned my addr 172.21.15.77:0/2477766774 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:05.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0655d9b700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f06580ce7f0 0x7f06580cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f065659c700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06580b04a0 0x7f06581f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 -- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f06580ce7f0 msgr2=0x7f06580cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f06580ce7f0 0x7f06580cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 -- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06580b04a0 msgr2=0x7f06581f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06580b04a0 0x7f06581f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0656d9d700 1 -- 172.21.15.77:0/2477766774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400095f0 con 0x7f065815b3d0 2023-08-31T00:27:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.691+0000 7f0655d9b700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f06580ce7f0 0x7f06580cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.692+0000 7f0656d9d700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 0x7f065814acd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f064800c480 tx=0x7f064800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.692+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011790 con 0x7f065815b3d0 2023-08-31T00:27:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.692+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0648011a00 con 0x7f065815b3d0 2023-08-31T00:27:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.692+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011e10 con 0x7f065815b3d0 2023-08-31T00:27:05.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.692+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06580c7c80 con 0x7f065815b3d0 2023-08-31T00:27:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.692+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06580c76c0 con 0x7f065815b3d0 2023-08-31T00:27:05.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.693+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065814a9f0 con 0x7f065815b3d0 2023-08-31T00:27:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.693+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f064801c460 con 0x7f065815b3d0 2023-08-31T00:27:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.693+0000 7f064effd700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f063806a110 0x7f063806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.693+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0648088450 con 0x7f065815b3d0 2023-08-31T00:27:05.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.693+0000 7f065659c700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f063806a110 0x7f063806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:05.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.694+0000 7f065659c700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f063806a110 0x7f063806c5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f065000a400 tx=0x7f065000d040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:05.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.698+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f065814a9f0 con 0x7f065815b3d0 2023-08-31T00:27:05.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.887+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f065814a9f0 con 0x7f065815b3d0 2023-08-31T00:27:05.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.888+0000 7f064effd700 1 -- 172.21.15.77:0/2477766774 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f065814a9f0 con 0x7f065815b3d0 2023-08-31T00:27:05.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:05.890 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:05.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f063806a110 msgr2=0x7f063806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f063806a110 0x7f063806c5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f065000a400 tx=0x7f065000d040 comp rx=0 tx=0).stop 2023-08-31T00:27:05.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 msgr2=0x7f065814acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:05.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 0x7f065814acd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f064800c480 tx=0x7f064800c790 comp rx=0 tx=0).stop 2023-08-31T00:27:05.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 shutdown_connections 2023-08-31T00:27:05.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f063806a110 0x7f063806c5d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065815b3d0 0x7f065814acd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06580b04a0 0x7f06581f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 --2- 172.21.15.77:0/2477766774 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f06580ce7f0 0x7f06580cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:05.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.890+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 >> 172.21.15.77:0/2477766774 conn(0x7f0658071630 msgr2=0x7f06580b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:05.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.891+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 shutdown_connections 2023-08-31T00:27:05.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:05.891+0000 7f065ca13700 1 -- 172.21.15.77:0/2477766774 wait complete. 2023-08-31T00:27:05.903 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-31T00:27:05.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:06.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f86228cb700 1 -- 172.21.15.77:0/2243235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 msgr2=0x7f8604005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f86228cb700 1 --2- 172.21.15.77:0/2243235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f8604005260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f861400c610 tx=0x7f8604005880 comp rx=0 tx=0).stop 2023-08-31T00:27:06.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f8620e68700 1 -- 172.21.15.77:0/2243235 reap_dead start 2023-08-31T00:27:06.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f86228cb700 1 -- 172.21.15.77:0/2243235 shutdown_connections 2023-08-31T00:27:06.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f86228cb700 1 -- 172.21.15.77:0/2243235 >> 172.21.15.77:0/2243235 conn(0x7f861c06cbf0 msgr2=0x7f861c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f86228cb700 1 -- 172.21.15.77:0/2243235 shutdown_connections 2023-08-31T00:27:06.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.025+0000 7f86228cb700 1 -- 172.21.15.77:0/2243235 wait complete. 2023-08-31T00:27:06.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.026+0000 7f86228cb700 1 Processor -- start 2023-08-31T00:27:06.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 -- start start 2023-08-31T00:27:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f861c0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f861c0c38d0 0x7f861c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861c0af3e0 0x7f861c0c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0c2ba0 con 0x7f8604004de0 2023-08-31T00:27:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0c7850 con 0x7f861c0af3e0 2023-08-31T00:27:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f86228cb700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0c2df0 con 0x7f861c0c38d0 2023-08-31T00:27:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f861bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f861c0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f861bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f861c0c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38514/0 (socket says 172.21.15.77:38514) 2023-08-31T00:27:06.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.027+0000 7f861bfff700 1 -- 172.21.15.77:0/1704508310 learned_addr learned my addr 172.21.15.77:0/1704508310 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f8620e68700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861c0af3e0 0x7f861c0c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861b7fe700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f861c0c38d0 0x7f861c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861bfff700 1 -- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f861c0c38d0 msgr2=0x7f861c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861bfff700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f861c0c38d0 0x7f861c150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861bfff700 1 -- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861c0af3e0 msgr2=0x7f861c0c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861bfff700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861c0af3e0 0x7f861c0c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861bfff700 1 -- 172.21.15.77:0/1704508310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c0c30d0 con 0x7f8604004de0 2023-08-31T00:27:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f8620e68700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861c0af3e0 0x7f861c0c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f861bfff700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f861c0c6f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f860c004e70 tx=0x7f860c00e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c013070 con 0x7f8604004de0 2023-08-31T00:27:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c0c33b0 con 0x7f8604004de0 2023-08-31T00:27:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c1513b0 con 0x7f8604004de0 2023-08-31T00:27:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f860c017410 con 0x7f8604004de0 2023-08-31T00:27:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.028+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c017780 con 0x7f8604004de0 2023-08-31T00:27:06.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.029+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc0052f0 con 0x7f8604004de0 2023-08-31T00:27:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.029+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f860c0178e0 con 0x7f8604004de0 2023-08-31T00:27:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.030+0000 7f8618ff9700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f860806a0e0 0x7f860806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.030+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f860c089c50 con 0x7f8604004de0 2023-08-31T00:27:06.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.030+0000 7f861b7fe700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f860806a0e0 0x7f860806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.030+0000 7f861b7fe700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f860806a0e0 0x7f860806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f861c15a4b0 tx=0x7f861000a250 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.034+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f860c08f020 con 0x7f8604004de0 2023-08-31T00:27:06.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.226+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85fc005870 con 0x7f8604004de0 2023-08-31T00:27:06.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.227+0000 7f8618ff9700 1 -- 172.21.15.77:0/1704508310 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f860c01c020 con 0x7f8604004de0 2023-08-31T00:27:06.229 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:06.230 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.229+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f860806a0e0 msgr2=0x7f860806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.229+0000 7f86228cb700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f860806a0e0 0x7f860806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f861c15a4b0 tx=0x7f861000a250 comp rx=0 tx=0).stop 2023-08-31T00:27:06.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.229+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 msgr2=0x7f861c0c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.229+0000 7f86228cb700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f861c0c6f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f860c004e70 tx=0x7f860c00e750 comp rx=0 tx=0).stop 2023-08-31T00:27:06.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 shutdown_connections 2023-08-31T00:27:06.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f860806a0e0 0x7f860806c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f861c0af3e0 0x7f861c0c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604004de0 0x7f861c0c6f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 --2- 172.21.15.77:0/1704508310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f861c0c38d0 0x7f861c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 >> 172.21.15.77:0/1704508310 conn(0x7f861c06cbf0 msgr2=0x7f861c15abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 shutdown_connections 2023-08-31T00:27:06.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.230+0000 7f86228cb700 1 -- 172.21.15.77:0/1704508310 wait complete. 2023-08-31T00:27:06.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-31T00:27:06.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-31T00:27:06.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-31T00:27:06.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-31T00:27:06.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-31T00:27:06.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-31T00:27:06.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-31T00:27:06.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-31T00:27:06.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.457+0000 7f1b13bfa700 1 -- 172.21.15.77:0/150417012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9b10 msgr2=0x7f1b0c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.457+0000 7f1b13bfa700 1 --2- 172.21.15.77:0/150417012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9b10 0x7f1b0c0cb7c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009970 tx=0x7f1b08009c80 comp rx=0 tx=0).stop 2023-08-31T00:27:06.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.458+0000 7f1b13bfa700 1 -- 172.21.15.77:0/150417012 shutdown_connections 2023-08-31T00:27:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.458+0000 7f1b13bfa700 1 --2- 172.21.15.77:0/150417012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9b10 0x7f1b0c0cb7c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.458+0000 7f1b13bfa700 1 --2- 172.21.15.77:0/150417012 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b0c15a230 0x7f1b0c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.458+0000 7f1b13bfa700 1 -- 172.21.15.77:0/150417012 >> 172.21.15.77:0/150417012 conn(0x7f1b0c06a4d0 msgr2=0x7f1b0c0aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.459+0000 7f1b13bfa700 1 -- 172.21.15.77:0/150417012 shutdown_connections 2023-08-31T00:27:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.459+0000 7f1b13bfa700 1 -- 172.21.15.77:0/150417012 wait complete. 2023-08-31T00:27:06.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.461+0000 7f1b13bfa700 1 Processor -- start 2023-08-31T00:27:06.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.461+0000 7f1b13bfa700 1 -- start start 2023-08-31T00:27:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 -- 172.21.15.77:0/404239388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 msgr2=0x7f5d4c0cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 --2- 172.21.15.77:0/404239388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c0cd1f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009fd0 tx=0x7f5d4400b380 comp rx=0 tx=0).stop 2023-08-31T00:27:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 -- 172.21.15.77:0/404239388 shutdown_connections 2023-08-31T00:27:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 --2- 172.21.15.77:0/404239388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c0cd1f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 --2- 172.21.15.77:0/404239388 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d4c071840 0x7f5d4c0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 -- 172.21.15.77:0/404239388 >> 172.21.15.77:0/404239388 conn(0x7f5d4c069d50 msgr2=0x7f5d4c06a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.460+0000 7f5d51bbe700 1 -- 172.21.15.77:0/404239388 shutdown_connections 2023-08-31T00:27:06.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.461+0000 7f5d51bbe700 1 -- 172.21.15.77:0/404239388 wait complete. 2023-08-31T00:27:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.463+0000 7f5d51bbe700 1 Processor -- start 2023-08-31T00:27:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.463+0000 7f1b13bfa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b0c0c9b10 0x7f1b0c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.464+0000 7f1b13bfa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9ef0 0x7f1b0c14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.464+0000 7f1b13bfa700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b0c15a230 0x7f1b0c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.464+0000 7f1b13bfa700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c149f60 con 0x7f1b0c0c9ef0 2023-08-31T00:27:06.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.464+0000 7f1b13bfa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c148be0 con 0x7f1b0c0c9b10 2023-08-31T00:27:06.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.464+0000 7f1b13bfa700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c148ec0 con 0x7f1b0c15a230 2023-08-31T00:27:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.464+0000 7f5d51bbe700 1 -- start start 2023-08-31T00:27:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d51bbe700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d4c06d170 0x7f5d4c0abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d51bbe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d4c071840 0x7f5d4c13e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d51bbe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c087540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d51bbe700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c13f3d0 con 0x7f5d4c15a960 2023-08-31T00:27:06.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d51bbe700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c13c840 con 0x7f5d4c071840 2023-08-31T00:27:06.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d51bbe700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c13ee10 con 0x7f5d4c06d170 2023-08-31T00:27:06.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b11195700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9ef0 0x7f1b0c14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b11195700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9ef0 0x7f1b0c14bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38536/0 (socket says 172.21.15.77:38536) 2023-08-31T00:27:06.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b11195700 1 -- 172.21.15.77:0/4279945633 learned_addr learned my addr 172.21.15.77:0/4279945633 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b12197700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b0c15a230 0x7f1b0c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b11996700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b0c0c9b10 0x7f1b0c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b12197700 1 -- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b0c0c9b10 msgr2=0x7f1b0c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b12197700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b0c0c9b10 0x7f1b0c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b12197700 1 -- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9ef0 msgr2=0x7f1b0c14bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b12197700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b0c0c9ef0 0x7f1b0c14bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f1b12197700 1 -- 172.21.15.77:0/4279945633 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08009580 con 0x7f1b0c15a230 2023-08-31T00:27:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.465+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c087540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c087540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38542/0 (socket says 172.21.15.77:38542) 2023-08-31T00:27:06.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 -- 172.21.15.77:0/2701658396 learned_addr learned my addr 172.21.15.77:0/2701658396 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4b7fe700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d4c06d170 0x7f5d4c0abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f1b12197700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b0c15a230 0x7f1b0c14c4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d680 tx=0x7f1afc00d990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc004a30 con 0x7f1b0c15a230 2023-08-31T00:27:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1afc004c80 con 0x7f1b0c15a230 2023-08-31T00:27:06.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc005280 con 0x7f1b0c15a230 2023-08-31T00:27:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 -- 172.21.15.77:0/2701658396 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d4c06d170 msgr2=0x7f5d4c0abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d4c06d170 0x7f5d4c0abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 -- 172.21.15.77:0/2701658396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d4c071840 msgr2=0x7f5d4c13e3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d4c071840 0x7f5d4c13e3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 -- 172.21.15.77:0/2701658396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009d00 con 0x7f5d4c15a960 2023-08-31T00:27:06.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.466+0000 7f5d4bfff700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c087540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c9a0 tx=0x7f5d3c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c007ac0 con 0x7f5d4c15a960 2023-08-31T00:27:06.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5d3c007d10 con 0x7f5d4c15a960 2023-08-31T00:27:06.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c004a90 con 0x7f5d4c15a960 2023-08-31T00:27:06.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c1491a0 con 0x7f1b0c15a230 2023-08-31T00:27:06.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c149760 con 0x7f1b0c15a230 2023-08-31T00:27:06.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c13f0f0 con 0x7f5d4c15a960 2023-08-31T00:27:06.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.467+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c142060 con 0x7f5d4c15a960 2023-08-31T00:27:06.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.469+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d4c0cb2f0 con 0x7f5d4c15a960 2023-08-31T00:27:06.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.469+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b0c0700c0 con 0x7f1b0c15a230 2023-08-31T00:27:06.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7feb61bcb700 1 -- 172.21.15.77:0/1345767746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 msgr2=0x7feb5c0c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7feb61bcb700 1 --2- 172.21.15.77:0/1345767746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 0x7feb5c0c98a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009840 tx=0x7feb4c009b50 comp rx=0 tx=0).stop 2023-08-31T00:27:06.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7feb61bcb700 1 -- 172.21.15.77:0/1345767746 shutdown_connections 2023-08-31T00:27:06.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7feb61bcb700 1 --2- 172.21.15.77:0/1345767746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 0x7feb5c0c98a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7feb61bcb700 1 -- 172.21.15.77:0/1345767746 >> 172.21.15.77:0/1345767746 conn(0x7feb5c06a4d0 msgr2=0x7feb5c0aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1afc0053e0 con 0x7f1b0c15a230 2023-08-31T00:27:06.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1b027fc700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1af006a1b0 0x7f1af006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1afc088400 con 0x7f1b0c15a230 2023-08-31T00:27:06.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1b027fc700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] conn(0x7f1af0072350 0x7f1af0074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 --> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1af0074e20 con 0x7f1af0072350 2023-08-31T00:27:06.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1afc053bc0 con 0x7f1b0c15a230 2023-08-31T00:27:06.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f1b11996700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1af006a1b0 0x7f1af006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f1b11195700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] conn(0x7f1af0072350 0x7f1af0074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f1b11195700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] conn(0x7f1af0072350 0x7f1af0074770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f1b11996700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1af006a1b0 0x7f1af006c670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000c00 tx=0x7f1b0802d040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== osd.0 v2:172.21.15.77:6800/1182377671 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1af0074e20 con 0x7f1af0072350 2023-08-31T00:27:06.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5d3c00f450 con 0x7f5d4c15a960 2023-08-31T00:27:06.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f5d33fff700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d3806a1b0 0x7f5d3806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d3c088dd0 con 0x7f5d4c15a960 2023-08-31T00:27:06.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f5d4b7fe700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d3806a1b0 0x7f5d3806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f5d33fff700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] conn(0x7f5d380723d0 0x7f5d380747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 --> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d38074ea0 con 0x7f5d380723d0 2023-08-31T00:27:06.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d3c089180 con 0x7f5d4c15a960 2023-08-31T00:27:06.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f5d4affd700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] conn(0x7f5d380723d0 0x7f5d380747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f5d4b7fe700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d3806a1b0 0x7f5d3806c670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400b070 tx=0x7f5d44014040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f5d4affd700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] conn(0x7f5d380723d0 0x7f5d380747f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7feb61bcb700 1 -- 172.21.15.77:0/1345767746 shutdown_connections 2023-08-31T00:27:06.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7feb61bcb700 1 -- 172.21.15.77:0/1345767746 wait complete. 2023-08-31T00:27:06.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7feb61bcb700 1 Processor -- start 2023-08-31T00:27:06.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1084c81700 1 -- 172.21.15.77:0/2217987981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 msgr2=0x7f1068003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f1084c81700 1 --2- 172.21.15.77:0/2217987981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 0x7f1068003e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1070009ca0 tx=0x7f1068005880 comp rx=0 tx=0).stop 2023-08-31T00:27:06.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.470+0000 7f107ed9d700 1 -- 172.21.15.77:0/2217987981 reap_dead start 2023-08-31T00:27:06.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f1084c81700 1 -- 172.21.15.77:0/2217987981 shutdown_connections 2023-08-31T00:27:06.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.471+0000 7f1084c81700 1 -- 172.21.15.77:0/2217987981 >> 172.21.15.77:0/2217987981 conn(0x7f1080071630 msgr2=0x7f1080071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.472+0000 7f1084c81700 1 -- 172.21.15.77:0/2217987981 shutdown_connections 2023-08-31T00:27:06.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.473+0000 7f1084c81700 1 -- 172.21.15.77:0/2217987981 wait complete. 2023-08-31T00:27:06.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.473+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== osd.1 v2:172.21.15.77:6824/1504479232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5d38074ea0 con 0x7f5d380723d0 2023-08-31T00:27:06.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 -- 172.21.15.77:0/1160690071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0cd1f0 msgr2=0x7f498c071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 --2- 172.21.15.77:0/1160690071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0cd1f0 0x7f498c071130 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4988005fd0 tx=0x7f498800b650 comp rx=0 tx=0).stop 2023-08-31T00:27:06.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 -- 172.21.15.77:0/1160690071 shutdown_connections 2023-08-31T00:27:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 --2- 172.21.15.77:0/1160690071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 0x7f498c0cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 --2- 172.21.15.77:0/1160690071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0cd1f0 0x7f498c071130 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 -- 172.21.15.77:0/1160690071 >> 172.21.15.77:0/1160690071 conn(0x7f498c069d50 msgr2=0x7f498c06a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 -- 172.21.15.77:0/1160690071 shutdown_connections 2023-08-31T00:27:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7fd798b28700 1 -- 172.21.15.77:0/844708226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941603d0 msgr2=0x7fd7940b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7fd798b28700 1 --2- 172.21.15.77:0/844708226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941603d0 0x7fd7940b4160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd784005fd0 tx=0x7fd784009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7f1084c81700 1 Processor -- start 2023-08-31T00:27:06.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7fd798b28700 1 -- 172.21.15.77:0/844708226 shutdown_connections 2023-08-31T00:27:06.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7fd798b28700 1 --2- 172.21.15.77:0/844708226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941603d0 0x7fd7940b4160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7fd798b28700 1 -- 172.21.15.77:0/844708226 >> 172.21.15.77:0/844708226 conn(0x7fd7940cdd90 msgr2=0x7fd7940ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7f1084c81700 1 -- start start 2023-08-31T00:27:06.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f1084c81700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 0x7f10800c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f1084c81700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f108015e070 0x7f10800c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7f49944b9700 1 -- 172.21.15.77:0/1160690071 wait complete. 2023-08-31T00:27:06.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f1084c81700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1080155670 0x7f1080154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f1084c81700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108015c1f0 con 0x7f1068003a00 2023-08-31T00:27:06.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f1084c81700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c54e0 con 0x7f108015e070 2023-08-31T00:27:06.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f1084c81700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c57c0 con 0x7f1080155670 2023-08-31T00:27:06.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f49944b9700 1 Processor -- start 2023-08-31T00:27:06.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f107e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 0x7f10800c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f49944b9700 1 -- start start 2023-08-31T00:27:06.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f107e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 0x7f10800c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38598/0 (socket says 172.21.15.77:38598) 2023-08-31T00:27:06.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7f107e59c700 1 -- 172.21.15.77:0/2663735955 learned_addr learned my addr 172.21.15.77:0/2663735955 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7fd798b28700 1 -- 172.21.15.77:0/844708226 shutdown_connections 2023-08-31T00:27:06.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7fd798b28700 1 -- 172.21.15.77:0/844708226 wait complete. 2023-08-31T00:27:06.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7f107e59c700 1 -- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1080155670 msgr2=0x7f1080154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7f107e59c700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1080155670 0x7f1080154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7f107e59c700 1 -- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f108015e070 msgr2=0x7f10800c4c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7f107e59c700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f108015e070 0x7f10800c4c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7f107e59c700 1 -- 172.21.15.77:0/2663735955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108015c440 con 0x7f1068003a00 2023-08-31T00:27:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f49944b9700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 0x7f498c0abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f49944b9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0cd1f0 0x7f498c0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f49944b9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f498c15a960 0x7f498c1e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f49944b9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c14cb00 con 0x7f498c0cd1f0 2023-08-31T00:27:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f49944b9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c1f49e0 con 0x7f498c15a960 2023-08-31T00:27:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f49944b9700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c14bef0 con 0x7f498c071670 2023-08-31T00:27:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 0x7f498c0abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 0x7f498c0abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:54542/0 (socket says 172.21.15.77:54542) 2023-08-31T00:27:06.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 -- 172.21.15.77:0/3291875666 learned_addr learned my addr 172.21.15.77:0/3291875666 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992a56700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f498c15a960 0x7f498c1e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7fb7b9d96700 1 -- 172.21.15.77:0/3251046433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b415a230 msgr2=0x7fb7b415a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7fb7b9d96700 1 --2- 172.21.15.77:0/3251046433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b415a230 0x7fb7b415a6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7a80098c0 tx=0x7fb7a8009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 -- 172.21.15.77:0/3291875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f498c15a960 msgr2=0x7f498c1e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f498c15a960 0x7f498c1e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7fb7b9d96700 1 -- 172.21.15.77:0/3251046433 shutdown_connections 2023-08-31T00:27:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7fb7b9d96700 1 --2- 172.21.15.77:0/3251046433 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b415a230 0x7fb7b415a6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7fb7b9d96700 1 --2- 172.21.15.77:0/3251046433 >> v2:172.21.15.77:3300/0 conn(0x7fb7b40c9ef0 0x7fb7b40cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7fb7b9d96700 1 -- 172.21.15.77:0/3251046433 >> 172.21.15.77:0/3251046433 conn(0x7fb7b406a4d0 msgr2=0x7fb7b40aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 -- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0cd1f0 msgr2=0x7f498c0ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0cd1f0 0x7f498c0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 -- 172.21.15.77:0/3291875666 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498800b050 con 0x7f498c071670 2023-08-31T00:27:06.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f4992255700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 0x7f498c0abbe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f497c00b470 tx=0x7f497c00b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f55e0f75700 1 -- 172.21.15.77:0/2975856289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc071840 msgr2=0x7f55dc0cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.474+0000 7feb61bcb700 1 -- start start 2023-08-31T00:27:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7feb61bcb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 0x7feb5c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7feb61bcb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c9de0 0x7feb5c0a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7feb61bcb700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb5c15b5e0 0x7feb5c14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7feb61bcb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06e1e0 con 0x7feb5c0c9de0 2023-08-31T00:27:06.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7feb61bcb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06dc20 con 0x7feb5c071960 2023-08-31T00:27:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.475+0000 7feb61bcb700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c06df00 con 0x7feb5c15b5e0 2023-08-31T00:27:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7feb5b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 0x7feb5c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7feb5b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 0x7feb5c06d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:50136/0 (socket says 172.21.15.77:50136) 2023-08-31T00:27:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7feb5b7fe700 1 -- 172.21.15.77:0/3731336870 learned_addr learned my addr 172.21.15.77:0/3731336870 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.476+0000 7feb5bfff700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb5c15b5e0 0x7feb5c14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7feb5bfff700 1 -- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 msgr2=0x7feb5c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7feb5bfff700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb5c071960 0x7feb5c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7feb5bfff700 1 -- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c9de0 msgr2=0x7feb5c0a64c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T00:27:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7feb5bfff700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb5c0c9de0 0x7feb5c0a64c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7feb5bfff700 1 -- 172.21.15.77:0/3731336870 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009520 con 0x7feb5c15b5e0 2023-08-31T00:27:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.477+0000 7feb5bfff700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb5c15b5e0 0x7feb5c14c0e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c890 tx=0x7feb5400cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f107e59c700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 0x7f10800c83e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1070016000 tx=0x7f1070004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.478+0000 7f55e0f75700 1 --2- 172.21.15.77:0/2975856289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc071840 0x7f55dc0cadb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007b30 tx=0x7f55d400d6a0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7fd798b28700 1 Processor -- start 2023-08-31T00:27:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f55e0f75700 1 -- 172.21.15.77:0/2975856289 shutdown_connections 2023-08-31T00:27:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f55e0f75700 1 --2- 172.21.15.77:0/2975856289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc071840 0x7f55dc0cadb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f55e0f75700 1 --2- 172.21.15.77:0/2975856289 >> v2:172.21.15.77:3300/0 conn(0x7f55dc15a960 0x7f55dc0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f55e0f75700 1 -- 172.21.15.77:0/2975856289 >> 172.21.15.77:0/2975856289 conn(0x7f55dc069d50 msgr2=0x7f55dc06a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7fb7b9d96700 1 -- 172.21.15.77:0/3251046433 shutdown_connections 2023-08-31T00:27:06.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7fd798b28700 1 -- start start 2023-08-31T00:27:06.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7fb7b9d96700 1 -- 172.21.15.77:0/3251046433 wait complete. 2023-08-31T00:27:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070005240 con 0x7f1068003a00 2023-08-31T00:27:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1070005490 con 0x7f1068003a00 2023-08-31T00:27:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070005840 con 0x7f1068003a00 2023-08-31T00:27:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108015c720 con 0x7f1068003a00 2023-08-31T00:27:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.479+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1080155b20 con 0x7f1068003a00 2023-08-31T00:27:06.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10800b3af0 con 0x7f1068003a00 2023-08-31T00:27:06.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7f55e0f75700 1 -- 172.21.15.77:0/2975856289 shutdown_connections 2023-08-31T00:27:06.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd798b28700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7940b34a0 0x7fd794159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd798b28700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd7941603d0 0x7fd794153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd798b28700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941607b0 0x7fd794153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd798b28700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940c5000 con 0x7fd7941607b0 2023-08-31T00:27:06.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd798b28700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794157f90 con 0x7fd7940b34a0 2023-08-31T00:27:06.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd798b28700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941587f0 con 0x7fd7941603d0 2023-08-31T00:27:06.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7f55e0f75700 1 -- 172.21.15.77:0/2975856289 wait complete. 2023-08-31T00:27:06.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd79259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7940b34a0 0x7fd794159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd79259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7940b34a0 0x7fd794159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:50164/0 (socket says 172.21.15.77:50164) 2023-08-31T00:27:06.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd79259c700 1 -- 172.21.15.77:0/4152041764 learned_addr learned my addr 172.21.15.77:0/4152041764 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd791d9b700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd7941603d0 0x7fd794153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.480+0000 7fd792d9d700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941607b0 0x7fd794153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7fd79259c700 1 -- 172.21.15.77:0/4152041764 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd7941603d0 msgr2=0x7fd794153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7fd79259c700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd7941603d0 0x7fd794153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7fd79259c700 1 -- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941607b0 msgr2=0x7fd794153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7fd79259c700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7941607b0 0x7fd794153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7fd79259c700 1 -- 172.21.15.77:0/4152041764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840095f0 con 0x7fd7940b34a0 2023-08-31T00:27:06.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011830 con 0x7f498c071670 2023-08-31T00:27:06.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f497c011a80 con 0x7f498c071670 2023-08-31T00:27:06.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011e90 con 0x7f498c071670 2023-08-31T00:27:06.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c14c1d0 con 0x7f498c071670 2023-08-31T00:27:06.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c14c790 con 0x7f498c071670 2023-08-31T00:27:06.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54003e30 con 0x7feb5c15b5e0 2023-08-31T00:27:06.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb5400ce90 con 0x7feb5c15b5e0 2023-08-31T00:27:06.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540052d0 con 0x7feb5c15b5e0 2023-08-31T00:27:06.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c14ce60 con 0x7feb5c15b5e0 2023-08-31T00:27:06.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c0a6a00 con 0x7feb5c15b5e0 2023-08-31T00:27:06.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.481+0000 7fb7b9d96700 1 Processor -- start 2023-08-31T00:27:06.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.482+0000 7f55e0f75700 1 Processor -- start 2023-08-31T00:27:06.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1070035440 con 0x7f1068003a00 2023-08-31T00:27:06.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.482+0000 7f55e0f75700 1 -- start start 2023-08-31T00:27:06.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fd79259c700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7940b34a0 0x7fd794159440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd784000c00 tx=0x7fd78400ba00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.482+0000 7fb7b9d96700 1 -- start start 2023-08-31T00:27:06.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fb7b9d96700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b40c9ef0 0x7fb7b40a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fb7b9d96700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7b415a230 0x7fb7b4201ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fb7b9d96700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7b40a77d0 0x7fb7b42021e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fb7b9d96700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40ab120 con 0x7fb7b40a77d0 2023-08-31T00:27:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fb7b9d96700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40a6450 con 0x7fb7b415a230 2023-08-31T00:27:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7fb7b9d96700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b40a6730 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f55e0f75700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55dc06d170 0x7f55dc155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f55e0f75700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55dc071840 0x7f55dc151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f55e0f75700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc15a960 0x7f55dc152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f55e0f75700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc1495c0 con 0x7f55dc071840 2023-08-31T00:27:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f55e0f75700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc155bd0 con 0x7f55dc06d170 2023-08-31T00:27:06.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f55e0f75700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc1489b0 con 0x7f55dc15a960 2023-08-31T00:27:06.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003680 con 0x7fd7940b34a0 2023-08-31T00:27:06.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7840038d0 con 0x7fd7940b34a0 2023-08-31T00:27:06.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784003ce0 con 0x7fd7940b34a0 2023-08-31T00:27:06.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b40c9ef0 0x7fb7b40a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f106effd700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f106006a0e0 0x7f106006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1070014070 con 0x7f1068003a00 2023-08-31T00:27:06.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f106effd700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] conn(0x7f1060072300 0x7f1060074720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 --> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1060074dd0 con 0x7f1060072300 2023-08-31T00:27:06.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.483+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f107008af60 con 0x7f1068003a00 2023-08-31T00:27:06.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f107dd9b700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f106006a0e0 0x7f106006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f107ed9d700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] conn(0x7f1060072300 0x7f1060074720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b40c9ef0 0x7fb7b40a8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:54562/0 (socket says 172.21.15.77:54562) 2023-08-31T00:27:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 -- 172.21.15.77:0/453468110 learned_addr learned my addr 172.21.15.77:0/453468110 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4974000fc0 con 0x7f498c071670 2023-08-31T00:27:06.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 -- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7b415a230 msgr2=0x7fb7b4201ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7b415a230 0x7fb7b4201ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 -- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7b40a77d0 msgr2=0x7fb7b42021e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7b40a77d0 0x7fb7b42021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.484+0000 7fb7b37fe700 1 -- 172.21.15.77:0/453468110 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009520 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794158ce0 con 0x7fd7940b34a0 2023-08-31T00:27:06.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd794158510 con 0x7fd7940b34a0 2023-08-31T00:27:06.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f107dd9b700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f106006a0e0 0x7f106006c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1080155170 tx=0x7f1074006770 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55dc071840 0x7f55dc151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55dc071840 0x7f55dc151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38628/0 (socket says 172.21.15.77:38628) 2023-08-31T00:27:06.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 -- 172.21.15.77:0/3221027252 learned_addr learned my addr 172.21.15.77:0/3221027252 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7fb7b37fe700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b40c9ef0 0x7fb7b40a8fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000fb0 tx=0x7fb7a400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f497c01a400 con 0x7f498c071670 2023-08-31T00:27:06.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f4982ffd700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f497006a1b0 0x7f497006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55dad9d700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc15a960 0x7f55dc152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 -- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc15a960 msgr2=0x7f55dc152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc15a960 0x7f55dc152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 -- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55dc06d170 msgr2=0x7f55dc155690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T00:27:06.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55dc06d170 0x7f55dc155690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55d9d9b700 1 -- 172.21.15.77:0/3221027252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4009e70 con 0x7f55dc071840 2023-08-31T00:27:06.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f55dad9d700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55dc15a960 0x7f55dc152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:06.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb54005430 con 0x7feb5c15b5e0 2023-08-31T00:27:06.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7feb43fff700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb4806a160 0x7feb4806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f497c088620 con 0x7f498c071670 2023-08-31T00:27:06.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f4982ffd700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] conn(0x7f4970072260 0x7f4970074680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 --> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4970074d30 con 0x7f4970072260 2023-08-31T00:27:06.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f497c08ac40 con 0x7f498c071670 2023-08-31T00:27:06.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7f4991a54700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f497006a1b0 0x7f497006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb54087b80 con 0x7feb5c15b5e0 2023-08-31T00:27:06.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4011790 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb7a40119e0 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.485+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4011df0 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40a6a10 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b40a6fd0 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7feb5b7fe700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb4806a160 0x7feb4806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7f107ed9d700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] conn(0x7f1060072300 0x7f1060074720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7f4991a54700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f497006a1b0 0x7f497006c670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f498c202040 tx=0x7f4988004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7feb5b7fe700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb4806a160 0x7feb4806c620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb50001740 tx=0x7feb50009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.486+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7b4070090 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f55d9d9b700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55dc071840 0x7f55dc151460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f55d000b4a0 tx=0x7f55d000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0011830 con 0x7f55dc071840 2023-08-31T00:27:06.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55d0011aa0 con 0x7f55dc071840 2023-08-31T00:27:06.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc148c90 con 0x7f55dc071840 2023-08-31T00:27:06.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0010380 con 0x7f55dc071840 2023-08-31T00:27:06.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc149250 con 0x7f55dc071840 2023-08-31T00:27:06.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd78400f460 con 0x7fd7940b34a0 2023-08-31T00:27:06.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.487+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== osd.7 v2:172.21.15.139:6816/926809794 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1060074dd0 con 0x7f1060072300 2023-08-31T00:27:06.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.488+0000 7fd782ffd700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77406a130 0x7fd77406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.488+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55dc06d9d0 con 0x7f55dc071840 2023-08-31T00:27:06.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.488+0000 7fd791d9b700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77406a130 0x7fd77406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.488+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd784089ec0 con 0x7fd7940b34a0 2023-08-31T00:27:06.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.488+0000 7fd791d9b700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77406a130 0x7fd77406c5f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7941f93a0 tx=0x7fd7880090e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.489+0000 7f4992a56700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] conn(0x7f4970072260 0x7f4970074680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.489+0000 7f4992a56700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] conn(0x7f4970072260 0x7f4970074680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.489+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f55d00104e0 con 0x7f55dc071840 2023-08-31T00:27:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7feb61bcb700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] conn(0x7feb3c0015e0 0x7feb3c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 --> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb3c006bd0 con 0x7feb3c0015e0 2023-08-31T00:27:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f55caffd700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f55bc06a0e0 0x7f55bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55d00878e0 con 0x7f55dc071840 2023-08-31T00:27:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f55caffd700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] conn(0x7f55bc072280 0x7f55bc0746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 --> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55bc074d50 con 0x7f55bc072280 2023-08-31T00:27:06.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55d0087c60 con 0x7f55dc071840 2023-08-31T00:27:06.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7feb5affd700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] conn(0x7feb3c0015e0 0x7feb3c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== osd.2 v2:172.21.15.77:6808/2822151791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4970074d30 con 0x7f4970072260 2023-08-31T00:27:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7f55dad9d700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] conn(0x7f55bc072280 0x7f55bc0746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7feb5affd700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] conn(0x7feb3c0015e0 0x7feb3c003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7f55da59c700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f55bc06a0e0 0x7f55bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7f55dad9d700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] conn(0x7f55bc072280 0x7f55bc0746a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7f55da59c700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f55bc06a0e0 0x7f55bc06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00a510 tx=0x7f55cc00a460 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.490+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb7a401c460 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb79bfff700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb7a006a130 0x7fb7a006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb7b2ffd700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb7a006a130 0x7fb7a006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7a4088db0 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb79bfff700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] conn(0x7fb7a0072350 0x7fb7a0074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 --> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7a0074e20 con 0x7fb7a0072350 2023-08-31T00:27:06.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a4089120 con 0x7fb7b40c9ef0 2023-08-31T00:27:06.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== osd.5 v2:172.21.15.139:6808/3613649331 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7feb3c006bd0 con 0x7feb3c0015e0 2023-08-31T00:27:06.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7fb7b2ffd700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb7a006a130 0x7fb7a006c5f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7b41fc2a0 tx=0x7fb7ac0085c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.492+0000 7fd798b28700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] conn(0x7fd794152b00 0x7fd7940606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.492+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 --> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd794073c30 con 0x7fd794152b00 2023-08-31T00:27:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.492+0000 7fd792d9d700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] conn(0x7fd794152b00 0x7fd7940606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.492+0000 7fd792d9d700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] conn(0x7fd794152b00 0x7fd7940606b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.493+0000 7fb7b3fff700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] conn(0x7fb7a0072350 0x7fb7a0074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.493+0000 7fb7b3fff700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] conn(0x7fb7a0072350 0x7fb7a0074770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.493+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== osd.3 v2:172.21.15.77:6809/2481662276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd794073c30 con 0x7fd794152b00 2023-08-31T00:27:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.494+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== osd.6 v2:172.21.15.139:6824/2255490164 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb7a0074e20 con 0x7fb7a0072350 2023-08-31T00:27:06.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.491+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== osd.4 v2:172.21.15.139:6800/285884193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f55bc074d50 con 0x7f55bc072280 2023-08-31T00:27:06.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.505+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 --> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d4c13c330 con 0x7f5d380723d0 2023-08-31T00:27:06.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.509+0000 7f5d33fff700 1 -- 172.21.15.77:0/2701658396 <== osd.1 v2:172.21.15.77:6824/1504479232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d4c13c330 con 0x7f5d380723d0 2023-08-31T00:27:06.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.511+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] conn(0x7f5d380723d0 msgr2=0x7f5d380747f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.511+0000 7f5d51bbe700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6824/1504479232,v1:172.21.15.77:6825/1504479232] conn(0x7f5d380723d0 0x7f5d380747f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.511+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d3806a1b0 msgr2=0x7f5d3806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.511+0000 7f5d51bbe700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d3806a1b0 0x7f5d3806c670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400b070 tx=0x7f5d44014040 comp rx=0 tx=0).stop 2023-08-31T00:27:06.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.511+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 msgr2=0x7f5d4c087540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.511+0000 7f5d51bbe700 1 --2- 172.21.15.77:0/2701658396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d4c15a960 0x7f5d4c087540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c9a0 tx=0x7f5d3c00cd60 comp rx=0 tx=0).stop 2023-08-31T00:27:06.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.514+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 --> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55dc149770 con 0x7f55bc072280 2023-08-31T00:27:06.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.515+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 --> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b0c073c30 con 0x7f1af0072350 2023-08-31T00:27:06.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.515+0000 7f5d4bfff700 1 -- 172.21.15.77:0/2701658396 reap_dead start 2023-08-31T00:27:06.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.515+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 shutdown_connections 2023-08-31T00:27:06.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.515+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 >> 172.21.15.77:0/2701658396 conn(0x7f5d4c069d50 msgr2=0x7f5d4c0aa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.515+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 shutdown_connections 2023-08-31T00:27:06.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.515+0000 7f5d51bbe700 1 -- 172.21.15.77:0/2701658396 wait complete. 2023-08-31T00:27:06.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55caffd700 1 -- 172.21.15.77:0/3221027252 <== osd.4 v2:172.21.15.139:6800/285884193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f55dc149770 con 0x7f55bc072280 2023-08-31T00:27:06.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 --> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7940d08a0 con 0x7fd794152b00 2023-08-31T00:27:06.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] conn(0x7f55bc072280 msgr2=0x7f55bc0746a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55e0f75700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.139:6800/285884193,v1:172.21.15.139:6801/285884193] conn(0x7f55bc072280 0x7f55bc0746a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f55bc06a0e0 msgr2=0x7f55bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55e0f75700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f55bc06a0e0 0x7f55bc06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00a510 tx=0x7f55cc00a460 comp rx=0 tx=0).stop 2023-08-31T00:27:06.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55dc071840 msgr2=0x7f55dc151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55e0f75700 1 --2- 172.21.15.77:0/3221027252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55dc071840 0x7f55dc151460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f55d000b4a0 tx=0x7f55d000b860 comp rx=0 tx=0).stop 2023-08-31T00:27:06.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7f55dad9d700 1 -- 172.21.15.77:0/3221027252 reap_dead start 2023-08-31T00:27:06.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.516+0000 7fd782ffd700 1 -- 172.21.15.77:0/4152041764 <== osd.3 v2:172.21.15.77:6809/2481662276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7940d08a0 con 0x7fd794152b00 2023-08-31T00:27:06.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 shutdown_connections 2023-08-31T00:27:06.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 >> 172.21.15.77:0/3221027252 conn(0x7f55dc069d50 msgr2=0x7f55dc158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] conn(0x7fd794152b00 msgr2=0x7fd7940606b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6809/2481662276,v1:172.21.15.77:6811/2481662276] conn(0x7fd794152b00 0x7fd7940606b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77406a130 msgr2=0x7fd77406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77406a130 0x7fd77406c5f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7941f93a0 tx=0x7fd7880090e0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7940b34a0 msgr2=0x7fd794159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 --2- 172.21.15.77:0/4152041764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7940b34a0 0x7fd794159440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd784000c00 tx=0x7fd78400ba00 comp rx=0 tx=0).stop 2023-08-31T00:27:06.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd792d9d700 1 -- 172.21.15.77:0/4152041764 reap_dead start 2023-08-31T00:27:06.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 shutdown_connections 2023-08-31T00:27:06.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 >> 172.21.15.77:0/4152041764 conn(0x7fd7940cdd90 msgr2=0x7fd794156130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 shutdown_connections 2023-08-31T00:27:06.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7fd798b28700 1 -- 172.21.15.77:0/4152041764 wait complete. 2023-08-31T00:27:06.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.517+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 --> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb3c005c50 con 0x7feb3c0015e0 2023-08-31T00:27:06.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.518+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 shutdown_connections 2023-08-31T00:27:06.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.518+0000 7f55e0f75700 1 -- 172.21.15.77:0/3221027252 wait complete. 2023-08-31T00:27:06.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.518+0000 7feb43fff700 1 -- 172.21.15.77:0/3731336870 <== osd.5 v2:172.21.15.139:6808/3613649331 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb3c005c50 con 0x7feb3c0015e0 2023-08-31T00:27:06.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.519+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 --> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10800c59e0 con 0x7f1060072300 2023-08-31T00:27:06.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.519+0000 7f106effd700 1 -- 172.21.15.77:0/2663735955 <== osd.7 v2:172.21.15.139:6816/926809794 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f10800c59e0 con 0x7f1060072300 2023-08-31T00:27:06.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] conn(0x7f1060072300 msgr2=0x7f1060074720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f1084c81700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.139:6816/926809794,v1:172.21.15.139:6817/926809794] conn(0x7f1060072300 0x7f1060074720 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f106006a0e0 msgr2=0x7f106006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f1084c81700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f106006a0e0 0x7f106006c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1080155170 tx=0x7f1074006770 comp rx=0 tx=0).stop 2023-08-31T00:27:06.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 msgr2=0x7f10800c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f1084c81700 1 --2- 172.21.15.77:0/2663735955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1068003a00 0x7f10800c83e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1070016000 tx=0x7f1070004f90 comp rx=0 tx=0).stop 2023-08-31T00:27:06.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.520+0000 7f107ed9d700 1 -- 172.21.15.77:0/2663735955 reap_dead start 2023-08-31T00:27:06.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7f1b027fc700 1 -- 172.21.15.77:0/4279945633 <== osd.0 v2:172.21.15.77:6800/1182377671 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b0c073c30 con 0x7f1af0072350 2023-08-31T00:27:06.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] conn(0x7feb3c0015e0 msgr2=0x7feb3c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7feb61bcb700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:6808/3613649331,v1:172.21.15.139:6809/3613649331] conn(0x7feb3c0015e0 0x7feb3c003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb4806a160 msgr2=0x7feb4806c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7feb61bcb700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb4806a160 0x7feb4806c620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb50001740 tx=0x7feb50009040 comp rx=0 tx=0).stop 2023-08-31T00:27:06.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb5c15b5e0 msgr2=0x7feb5c14c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.521+0000 7feb61bcb700 1 --2- 172.21.15.77:0/3731336870 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feb5c15b5e0 0x7feb5c14c0e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c890 tx=0x7feb5400cc50 comp rx=0 tx=0).stop 2023-08-31T00:27:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.522+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 --> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4974002d40 con 0x7f4970072260 2023-08-31T00:27:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.522+0000 7feb5bfff700 1 -- 172.21.15.77:0/3731336870 reap_dead start 2023-08-31T00:27:06.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.522+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 shutdown_connections 2023-08-31T00:27:06.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.522+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 >> 172.21.15.77:0/2663735955 conn(0x7f1080071630 msgr2=0x7f1080158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.522+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 shutdown_connections 2023-08-31T00:27:06.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.522+0000 7f1084c81700 1 -- 172.21.15.77:0/2663735955 wait complete. 2023-08-31T00:27:06.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 shutdown_connections 2023-08-31T00:27:06.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 >> 172.21.15.77:0/3731336870 conn(0x7feb5c06a4d0 msgr2=0x7feb5c0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f4982ffd700 1 -- 172.21.15.77:0/3291875666 <== osd.2 v2:172.21.15.77:6808/2822151791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4974002d40 con 0x7f4970072260 2023-08-31T00:27:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] conn(0x7f4970072260 msgr2=0x7f4970074680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f49944b9700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6808/2822151791,v1:172.21.15.77:6810/2822151791] conn(0x7f4970072260 0x7f4970074680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f497006a1b0 msgr2=0x7f497006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f49944b9700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f497006a1b0 0x7f497006c670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f498c202040 tx=0x7f4988004750 comp rx=0 tx=0).stop 2023-08-31T00:27:06.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 msgr2=0x7f498c0abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f49944b9700 1 --2- 172.21.15.77:0/3291875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f498c071670 0x7f498c0abbe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f497c00b470 tx=0x7f497c00b830 comp rx=0 tx=0).stop 2023-08-31T00:27:06.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.523+0000 7f4992a56700 1 -- 172.21.15.77:0/3291875666 reap_dead start 2023-08-31T00:27:06.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.525+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 shutdown_connections 2023-08-31T00:27:06.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.525+0000 7feb61bcb700 1 -- 172.21.15.77:0/3731336870 wait complete. 2023-08-31T00:27:06.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.528+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 --> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7b4073c30 con 0x7fb7a0072350 2023-08-31T00:27:06.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.528+0000 7fb79bfff700 1 -- 172.21.15.77:0/453468110 <== osd.6 v2:172.21.15.139:6824/2255490164 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7b4073c30 con 0x7fb7a0072350 2023-08-31T00:27:06.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] conn(0x7fb7a0072350 msgr2=0x7fb7a0074770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b9d96700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:6824/2255490164,v1:172.21.15.139:6825/2255490164] conn(0x7fb7a0072350 0x7fb7a0074770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb7a006a130 msgr2=0x7fb7a006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b9d96700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb7a006a130 0x7fb7a006c5f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb7b41fc2a0 tx=0x7fb7ac0085c0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b40c9ef0 msgr2=0x7fb7b40a8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b9d96700 1 --2- 172.21.15.77:0/453468110 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb7b40c9ef0 0x7fb7b40a8fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000fb0 tx=0x7fb7a400c7b0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.529+0000 7fb7b3fff700 1 -- 172.21.15.77:0/453468110 reap_dead start 2023-08-31T00:27:06.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.530+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 shutdown_connections 2023-08-31T00:27:06.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.530+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 >> 172.21.15.77:0/3291875666 conn(0x7f498c069d50 msgr2=0x7f498c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.532+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 shutdown_connections 2023-08-31T00:27:06.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.532+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 >> 172.21.15.77:0/453468110 conn(0x7fb7b406a4d0 msgr2=0x7fb7b40adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.533+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 shutdown_connections 2023-08-31T00:27:06.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.533+0000 7fb7b9d96700 1 -- 172.21.15.77:0/453468110 wait complete. 2023-08-31T00:27:06.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] conn(0x7f1af0072350 msgr2=0x7f1af0074770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b13bfa700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6800/1182377671,v1:172.21.15.77:6801/1182377671] conn(0x7f1af0072350 0x7f1af0074770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1af006a1b0 msgr2=0x7f1af006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b13bfa700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1af006a1b0 0x7f1af006c670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000c00 tx=0x7f1b0802d040 comp rx=0 tx=0).stop 2023-08-31T00:27:06.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b0c15a230 msgr2=0x7f1b0c14c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b13bfa700 1 --2- 172.21.15.77:0/4279945633 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1b0c15a230 0x7f1b0c14c4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d680 tx=0x7f1afc00d990 comp rx=0 tx=0).stop 2023-08-31T00:27:06.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.536+0000 7f1b12197700 1 -- 172.21.15.77:0/4279945633 reap_dead start 2023-08-31T00:27:06.599 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:06.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T00:27:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.537+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 shutdown_connections 2023-08-31T00:27:06.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.537+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 >> 172.21.15.77:0/4279945633 conn(0x7f1b0c06a4d0 msgr2=0x7f1b0c150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.538+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 shutdown_connections 2023-08-31T00:27:06.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.538+0000 7f49944b9700 1 -- 172.21.15.77:0/3291875666 wait complete. 2023-08-31T00:27:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.540+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 shutdown_connections 2023-08-31T00:27:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.540+0000 7f1b13bfa700 1 -- 172.21.15.77:0/4279945633 wait complete. 2023-08-31T00:27:06.603 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:06.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T00:27:06.605 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-08-31T00:27:06.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T00:27:06.606 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:06.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T00:27:06.608 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:06.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T00:27:06.609 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:06.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T00:27:06.610 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:06.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T00:27:06.612 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:06.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T00:27:06.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 -- 172.21.15.77:0/3515902495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a940c9ef0 msgr2=0x7f2a940715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/3515902495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a940c9ef0 0x7f2a940715c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2a940af6c0 tx=0x7f2a88009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:06.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 -- 172.21.15.77:0/3515902495 shutdown_connections 2023-08-31T00:27:06.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/3515902495 >> v2:172.21.15.139:3300/0 conn(0x7f2a940c9b10 0x7f2a940cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/3515902495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a940c9ef0 0x7f2a940715c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 -- 172.21.15.77:0/3515902495 >> 172.21.15.77:0/3515902495 conn(0x7f2a9406a4d0 msgr2=0x7f2a940aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 -- 172.21.15.77:0/3515902495 shutdown_connections 2023-08-31T00:27:06.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.842+0000 7f2a9aacd700 1 -- 172.21.15.77:0/3515902495 wait complete. 2023-08-31T00:27:06.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.844+0000 7f2a9aacd700 1 Processor -- start 2023-08-31T00:27:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.844+0000 7f2a9aacd700 1 -- start start 2023-08-31T00:27:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9aacd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a940c9b10 0x7f2a9415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9aacd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a940c9ef0 0x7f2a94152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9aacd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 0x7f2a941514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9aacd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94150ac0 con 0x7f2a9415f0e0 2023-08-31T00:27:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9aacd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9415bc30 con 0x7f2a940c9b10 2023-08-31T00:27:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9aacd700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a94155780 con 0x7f2a940c9ef0 2023-08-31T00:27:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9906a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 0x7f2a941514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9906a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 0x7f2a941514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38658/0 (socket says 172.21.15.77:38658) 2023-08-31T00:27:06.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.846+0000 7f2a9906a700 1 -- 172.21.15.77:0/588368078 learned_addr learned my addr 172.21.15.77:0/588368078 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.847+0000 7f2a9906a700 1 -- 172.21.15.77:0/588368078 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a940c9ef0 msgr2=0x7f2a94152c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.847+0000 7f2a9906a700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a940c9ef0 0x7f2a94152c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.847+0000 7f2a9906a700 1 -- 172.21.15.77:0/588368078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a940c9b10 msgr2=0x7f2a9415b6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.847+0000 7f2a9906a700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a940c9b10 0x7f2a9415b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.847+0000 7f2a9906a700 1 -- 172.21.15.77:0/588368078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880095f0 con 0x7f2a9415f0e0 2023-08-31T00:27:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.847+0000 7f2a9906a700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 0x7f2a941514c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c7a0 tx=0x7f2a8c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.848+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c003e10 con 0x7f2a9415f0e0 2023-08-31T00:27:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.848+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2a8c0051a0 con 0x7f2a9415f0e0 2023-08-31T00:27:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.848+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0055b0 con 0x7f2a9415f0e0 2023-08-31T00:27:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.848+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a941531b0 con 0x7f2a9415f0e0 2023-08-31T00:27:06.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.848+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a94154e50 con 0x7f2a9415f0e0 2023-08-31T00:27:06.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.850+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a94073c30 con 0x7f2a9415f0e0 2023-08-31T00:27:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.851+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a8c005710 con 0x7f2a9415f0e0 2023-08-31T00:27:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.852+0000 7f2a917fa700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2a8006a1b0 0x7f2a8006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.852+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a8c087cf0 con 0x7f2a9415f0e0 2023-08-31T00:27:06.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.852+0000 7f2a98869700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2a8006a1b0 0x7f2a8006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.853+0000 7f2a98869700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2a8006a1b0 0x7f2a8006c670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009660 tx=0x7f2a84006c00 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.858+0000 7f4dac443700 1 -- 172.21.15.77:0/2128747029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da406ceb0 msgr2=0x7f4da406d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.858+0000 7f4dac443700 1 --2- 172.21.15.77:0/2128747029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da406ceb0 0x7f4da406d730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4da00098c0 tx=0x7f4da0009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.860+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a8c053560 con 0x7f2a9415f0e0 2023-08-31T00:27:06.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 -- 172.21.15.77:0/1249218199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c0ab420 msgr2=0x7f7a8c0c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 --2- 172.21.15.77:0/1249218199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c0ab420 0x7f7a8c0c92e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c06bad0 tx=0x7f7a7c009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f4dac443700 1 -- 172.21.15.77:0/2128747029 shutdown_connections 2023-08-31T00:27:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f4dac443700 1 --2- 172.21.15.77:0/2128747029 >> v2:172.21.15.139:3300/0 conn(0x7f4da4158160 0x7f4da40ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f4dac443700 1 --2- 172.21.15.77:0/2128747029 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da406ceb0 0x7f4da406d730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f4dac443700 1 -- 172.21.15.77:0/2128747029 >> 172.21.15.77:0/2128747029 conn(0x7f4da406a4d0 msgr2=0x7f4da40aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 -- 172.21.15.77:0/1249218199 shutdown_connections 2023-08-31T00:27:06.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 --2- 172.21.15.77:0/1249218199 >> v2:172.21.15.139:3300/0 conn(0x7f7a8c06ad90 0x7f7a8c0aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 --2- 172.21.15.77:0/1249218199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c0ab420 0x7f7a8c0c92e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 -- 172.21.15.77:0/1249218199 >> 172.21.15.77:0/1249218199 conn(0x7f7a8c070270 msgr2=0x7f7a8c070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 -- 172.21.15.77:0/1249218199 shutdown_connections 2023-08-31T00:27:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.861+0000 7f7a92325700 1 -- 172.21.15.77:0/1249218199 wait complete. 2023-08-31T00:27:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.862+0000 7f4dac443700 1 -- 172.21.15.77:0/2128747029 shutdown_connections 2023-08-31T00:27:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.863+0000 7f7a92325700 1 Processor -- start 2023-08-31T00:27:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.863+0000 7fe6732e7700 1 -- 172.21.15.77:0/566393877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe658005210 msgr2=0x7fe65800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.863+0000 7fe6732e7700 1 --2- 172.21.15.77:0/566393877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe658005210 0x7fe65800ba10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe664002230 tx=0x7fe658005880 comp rx=0 tx=0).stop 2023-08-31T00:27:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7fe6732e7700 1 -- 172.21.15.77:0/566393877 shutdown_connections 2023-08-31T00:27:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7fe6732e7700 1 --2- 172.21.15.77:0/566393877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe658005210 0x7fe65800ba10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7fe6732e7700 1 -- 172.21.15.77:0/566393877 >> 172.21.15.77:0/566393877 conn(0x7fe66c0cdd90 msgr2=0x7fe66c0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.863+0000 7f7a92325700 1 -- start start 2023-08-31T00:27:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f7a92325700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c06ad90 0x7f7a8c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f7a92325700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a8c06b170 0x7f7a8c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f7a92325700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 0x7f7a8c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f0393584700 1 -- 172.21.15.77:0/366218697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0374003a00 msgr2=0x7f0374003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f0393584700 1 --2- 172.21.15.77:0/366218697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0374003a00 0x7f0374003e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f038400c790 tx=0x7f0374005880 comp rx=0 tx=0).stop 2023-08-31T00:27:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f7a92325700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15abe0 con 0x7f7a8c06ad90 2023-08-31T00:27:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f7a92325700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0c1270 con 0x7f7a8c06b170 2023-08-31T00:27:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f7a92325700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15d910 con 0x7f7a8c0ab420 2023-08-31T00:27:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7fe6732e7700 1 -- 172.21.15.77:0/566393877 shutdown_connections 2023-08-31T00:27:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.862+0000 7f4dac443700 1 -- 172.21.15.77:0/2128747029 wait complete. 2023-08-31T00:27:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f4dac443700 1 Processor -- start 2023-08-31T00:27:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7f0391b21700 1 -- 172.21.15.77:0/366218697 reap_dead start 2023-08-31T00:27:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.865+0000 7f4dac443700 1 -- start start 2023-08-31T00:27:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.864+0000 7fe6732e7700 1 -- 172.21.15.77:0/566393877 wait complete. 2023-08-31T00:27:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.865+0000 7fe6732e7700 1 Processor -- start 2023-08-31T00:27:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f0393584700 1 -- 172.21.15.77:0/366218697 shutdown_connections 2023-08-31T00:27:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f0393584700 1 -- 172.21.15.77:0/366218697 >> 172.21.15.77:0/366218697 conn(0x7f038c0cd370 msgr2=0x7f038c0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 0x7f7a8c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 0x7f7a8c157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:54644/0 (socket says 172.21.15.77:54644) 2023-08-31T00:27:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 -- 172.21.15.77:0/2558170394 learned_addr learned my addr 172.21.15.77:0/2558170394 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4dac443700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 0x7f4da414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4dac443700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da40cbec0 0x7f4da415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4dac443700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da4158160 0x7f4da415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4dac443700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da414cd20 con 0x7f4da40cbec0 2023-08-31T00:27:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4dac443700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da415a0d0 con 0x7f4da406ceb0 2023-08-31T00:27:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4dac443700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da415a3b0 con 0x7f4da4158160 2023-08-31T00:27:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 -- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a8c06b170 msgr2=0x7f7a8c15a6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a8c06b170 0x7f7a8c15a6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 -- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c06ad90 msgr2=0x7f7a8c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c06ad90 0x7f7a8c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 -- 172.21.15.77:0/2558170394 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c009520 con 0x7f7a8c0ab420 2023-08-31T00:27:06.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4daa1df700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 0x7f4da414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4daa1df700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 0x7f4da414c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:50266/0 (socket says 172.21.15.77:50266) 2023-08-31T00:27:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4daa1df700 1 -- 172.21.15.77:0/3070960644 learned_addr learned my addr 172.21.15.77:0/3070960644 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f7a908c2700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 0x7f7a8c157c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400c8a0 tx=0x7f7a8400cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4daa1df700 1 -- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da4158160 msgr2=0x7f4da415ae90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7f4daa1df700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da4158160 0x7f4da415ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f4daa1df700 1 -- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da40cbec0 msgr2=0x7f4da415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f4daa1df700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da40cbec0 0x7f4da415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f4daa1df700 1 -- 172.21.15.77:0/3070960644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009520 con 0x7f4da406ceb0 2023-08-31T00:27:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400cea0 con 0x7f7a8c0ab420 2023-08-31T00:27:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a84005070 con 0x7f7a8c0ab420 2023-08-31T00:27:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84005460 con 0x7f7a8c0ab420 2023-08-31T00:27:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7fe6732e7700 1 -- start start 2023-08-31T00:27:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.866+0000 7fe6732e7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe658005210 0x7fe66c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7fe6732e7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 0x7fe66c159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7fe6732e7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c153f00 0x7fe66c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7fe6732e7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c156540 con 0x7fe658005210 2023-08-31T00:27:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7fe6732e7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1548c0 con 0x7fe66c1584e0 2023-08-31T00:27:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7fe6732e7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1596b0 con 0x7fe66c153f00 2023-08-31T00:27:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c0c1530 con 0x7f7a8c0ab420 2023-08-31T00:27:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.867+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c15d350 con 0x7f7a8c0ab420 2023-08-31T00:27:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7f4daa1df700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 0x7f4da414c7e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b480 tx=0x7f4d9400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94005a00 con 0x7f4da406ceb0 2023-08-31T00:27:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 0x7fe66c159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 0x7fe66c159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:50274/0 (socket says 172.21.15.77:50274) 2023-08-31T00:27:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 -- 172.21.15.77:0/781309961 learned_addr learned my addr 172.21.15.77:0/781309961 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe671083700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe658005210 0x7fe66c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d94005c50 con 0x7f4da406ceb0 2023-08-31T00:27:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940116f0 con 0x7f4da406ceb0 2023-08-31T00:27:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da415a690 con 0x7f4da406ceb0 2023-08-31T00:27:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da415c4a0 con 0x7f4da406ceb0 2023-08-31T00:27:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe671884700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c153f00 0x7fe66c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 -- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c153f00 msgr2=0x7fe66c154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c153f00 0x7fe66c154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 -- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe658005210 msgr2=0x7fe66c156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.868+0000 7fe670882700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe658005210 0x7fe66c156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7fe670882700 1 -- 172.21.15.77:0/781309961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c158aa0 con 0x7fe66c1584e0 2023-08-31T00:27:06.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c0052f0 con 0x7f4da406ceb0 2023-08-31T00:27:06.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c073c30 con 0x7f7a8c0ab420 2023-08-31T00:27:06.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 -- 172.21.15.77:0/3320156936 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 msgr2=0x7f8650010020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 --2- 172.21.15.77:0/3320156936 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 0x7f8650010020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f865400aca0 tx=0x7f8650005880 comp rx=0 tx=0).stop 2023-08-31T00:27:06.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 -- 172.21.15.77:0/3320156936 shutdown_connections 2023-08-31T00:27:06.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 --2- 172.21.15.77:0/3320156936 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 0x7f8650010020 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 -- 172.21.15.77:0/3320156936 >> 172.21.15.77:0/3320156936 conn(0x7f8664070270 msgr2=0x7f8664070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 -- 172.21.15.77:0/3320156936 shutdown_connections 2023-08-31T00:27:06.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.869+0000 7f866b72f700 1 -- 172.21.15.77:0/3320156936 wait complete. 2023-08-31T00:27:06.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.870+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d94011850 con 0x7f4da406ceb0 2023-08-31T00:27:06.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.871+0000 7f4d9affd700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4d8806a0b0 0x7f4d8806c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.871+0000 7f866b72f700 1 Processor -- start 2023-08-31T00:27:06.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.871+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d94088740 con 0x7f4da406ceb0 2023-08-31T00:27:06.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.871+0000 7f4da99de700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4d8806a0b0 0x7f4d8806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f4da99de700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4d8806a0b0 0x7f4d8806c570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4da4066610 tx=0x7f4da0019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f0393584700 1 -- 172.21.15.77:0/366218697 shutdown_connections 2023-08-31T00:27:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.871+0000 7f866b72f700 1 -- start start 2023-08-31T00:27:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f866b72f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 0x7f8664155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f866b72f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 0x7f866414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f866b72f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86640ae360 0x7f86640ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f866b72f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866414c3d0 con 0x7f866414bb50 2023-08-31T00:27:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f866b72f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664155580 con 0x7f86640ae360 2023-08-31T00:27:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f866b72f700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86641557b0 con 0x7f8650005030 2023-08-31T00:27:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.871+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7a840055c0 con 0x7f7a8c0ab420 2023-08-31T00:27:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f7a88ff9700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7a7806a130 0x7f7a7806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a84087d90 con 0x7f7a8c0ab420 2023-08-31T00:27:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f8668cca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 0x7f866414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f8668cca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 0x7f866414b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38730/0 (socket says 172.21.15.77:38730) 2023-08-31T00:27:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f8668cca700 1 -- 172.21.15.77:0/1783962735 learned_addr learned my addr 172.21.15.77:0/1783962735 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f7a8bfff700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7a7806a130 0x7f7a7806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f8669ccc700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86640ae360 0x7f86640ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8668cca700 1 -- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 msgr2=0x7f8664155040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8668cca700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 0x7f8664155040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8668cca700 1 -- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86640ae360 msgr2=0x7f86640ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8668cca700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86640ae360 0x7f86640ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8668cca700 1 -- 172.21.15.77:0/1783962735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640c1360 con 0x7f866414bb50 2023-08-31T00:27:06.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f7a8bfff700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7a7806a130 0x7f7a7806c5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a80005950 tx=0x7f7a800058e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8668cca700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 0x7f866414b3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f865c00ea00 tx=0x7f865c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00cb60 con 0x7f866414bb50 2023-08-31T00:27:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f865c00cdb0 con 0x7f866414bb50 2023-08-31T00:27:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640aed30 con 0x7f866414bb50 2023-08-31T00:27:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0116c0 con 0x7f866414bb50 2023-08-31T00:27:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.873+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640b2460 con 0x7f866414bb50 2023-08-31T00:27:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7f0393584700 1 -- 172.21.15.77:0/366218697 wait complete. 2023-08-31T00:27:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.874+0000 7f0393584700 1 Processor -- start 2023-08-31T00:27:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640ad110 con 0x7f866414bb50 2023-08-31T00:27:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f865c011820 con 0x7f866414bb50 2023-08-31T00:27:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f8659ffb700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f864806a0e0 0x7f864806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.874+0000 7f0393584700 1 -- start start 2023-08-31T00:27:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7f0393584700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0374003a00 0x7f038c095ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7f0393584700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 0x7f038c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0393584700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f038c0b0820 0x7f038c1f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0393584700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0b0cd0 con 0x7f038c0b0820 2023-08-31T00:27:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0393584700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c151850 con 0x7f0374003a00 2023-08-31T00:27:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0393584700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c096df0 con 0x7f038c09ae00 2023-08-31T00:27:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0391320700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0374003a00 0x7f038c095ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0390b1f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 0x7f038c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0390b1f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 0x7f038c0b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.77:54670/0 (socket says 172.21.15.77:54670) 2023-08-31T00:27:06.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0390b1f700 1 -- 172.21.15.77:0/65783752 learned_addr learned my addr 172.21.15.77:0/65783752 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f0391b21700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f038c0b0820 0x7f038c1f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.872+0000 7fe670882700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 0x7fe66c159b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00d650 tx=0x7fe65c00d960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.874+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c004a30 con 0x7fe66c1584e0 2023-08-31T00:27:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe65c004ca0 con 0x7fe66c1584e0 2023-08-31T00:27:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c005280 con 0x7fe66c1584e0 2023-08-31T00:27:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c158d80 con 0x7fe66c1584e0 2023-08-31T00:27:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.875+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c159340 con 0x7fe66c1584e0 2023-08-31T00:27:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f865c088da0 con 0x7f866414bb50 2023-08-31T00:27:06.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.876+0000 7f86694cb700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f864806a0e0 0x7f864806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0390b1f700 1 -- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0374003a00 msgr2=0x7f038c095ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0390b1f700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0374003a00 0x7f038c095ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0390b1f700 1 -- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f038c0b0820 msgr2=0x7f038c1f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0390b1f700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f038c0b0820 0x7f038c1f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0390b1f700 1 -- 172.21.15.77:0/65783752 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c1515b0 con 0x7f038c09ae00 2023-08-31T00:27:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0390b1f700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 0x7f038c0b02e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f038000b580 tx=0x7f038000b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f86694cb700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f864806a0e0 0x7f864806c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86640b2f60 tx=0x7f8660007a40 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011830 con 0x7f038c09ae00 2023-08-31T00:27:06.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0380011a80 con 0x7f038c09ae00 2023-08-31T00:27:06.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380011e90 con 0x7f038c09ae00 2023-08-31T00:27:06.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.877+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c0966a0 con 0x7f038c09ae00 2023-08-31T00:27:06.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.878+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c0b2fb0 con 0x7f038c09ae00 2023-08-31T00:27:06.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.878+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe65c0053e0 con 0x7fe66c1584e0 2023-08-31T00:27:06.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.879+0000 7fe661ffb700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe65006a0e0 0x7fe65006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.879+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe65c088370 con 0x7fe66c1584e0 2023-08-31T00:27:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.879+0000 7fe671083700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe65006a0e0 0x7fe65006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.879+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4d94054000 con 0x7f4da406ceb0 2023-08-31T00:27:06.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.879+0000 7fe671083700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe65006a0e0 0x7fe65006c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe668007fd0 tx=0x7fe668007e40 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.879+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7a840570f0 con 0x7f7a8c0ab420 2023-08-31T00:27:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.880+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f038001a400 con 0x7f038c09ae00 2023-08-31T00:27:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.880+0000 7f0389ffb700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f037806a130 0x7f037806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.880+0000 7f0391320700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f037806a130 0x7f037806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.880+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0380088460 con 0x7f038c09ae00 2023-08-31T00:27:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.881+0000 7f0391320700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f037806a130 0x7f037806c5f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0384001cb0 tx=0x7f038400f000 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.882+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c0052f0 con 0x7fe66c1584e0 2023-08-31T00:27:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.883+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f865c054590 con 0x7f866414bb50 2023-08-31T00:27:06.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.883+0000 7f2664467700 1 -- 172.21.15.77:0/3793063893 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 msgr2=0x7f265c0b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.883+0000 7f2664467700 1 --2- 172.21.15.77:0/3793063893 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 0x7f265c0b17f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f264c009990 tx=0x7f264c009ca0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.884+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c0052f0 con 0x7f038c09ae00 2023-08-31T00:27:06.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.887+0000 7f2664467700 1 -- 172.21.15.77:0/3793063893 shutdown_connections 2023-08-31T00:27:06.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.887+0000 7f2664467700 1 --2- 172.21.15.77:0/3793063893 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 0x7f265c0b17f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.887+0000 7f2664467700 1 -- 172.21.15.77:0/3793063893 >> 172.21.15.77:0/3793063893 conn(0x7f265c06a4d0 msgr2=0x7f265c0aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.889+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe65c053ab0 con 0x7fe66c1584e0 2023-08-31T00:27:06.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.889+0000 7f2664467700 1 -- 172.21.15.77:0/3793063893 shutdown_connections 2023-08-31T00:27:06.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.889+0000 7f2664467700 1 -- 172.21.15.77:0/3793063893 wait complete. 2023-08-31T00:27:06.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.891+0000 7f2664467700 1 Processor -- start 2023-08-31T00:27:06.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.891+0000 7f2664467700 1 -- start start 2023-08-31T00:27:06.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.892+0000 7f2664467700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 0x7f265c0a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.892+0000 7f2664467700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f265c165d70 0x7f265c0a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.892+0000 7f2664467700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 0x7f265c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.892+0000 7f2664467700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c0a87a0 con 0x7f265c0b1d30 2023-08-31T00:27:06.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.892+0000 7f2664467700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06d470 con 0x7f265c165d70 2023-08-31T00:27:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.892+0000 7f2664467700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265c06d190 con 0x7f265c169360 2023-08-31T00:27:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 0x7f265c0a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 0x7f265c0a8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38752/0 (socket says 172.21.15.77:38752) 2023-08-31T00:27:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 -- 172.21.15.77:0/1476126111 learned_addr learned my addr 172.21.15.77:0/1476126111 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 -- 172.21.15.77:0/1476126111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 msgr2=0x7f265c06c540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 0x7f265c06c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 -- 172.21.15.77:0/1476126111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f265c165d70 msgr2=0x7f265c0a9200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f265c165d70 0x7f265c0a9200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.893+0000 7f2662203700 1 -- 172.21.15.77:0/1476126111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0095f0 con 0x7f265c0b1d30 2023-08-31T00:27:06.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.889+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0380053ca0 con 0x7f038c09ae00 2023-08-31T00:27:06.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.894+0000 7f2662203700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 0x7f265c0a8cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f265800c500 tx=0x7f265800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.894+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26580052d0 con 0x7f265c0b1d30 2023-08-31T00:27:06.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.894+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2658005540 con 0x7f265c0b1d30 2023-08-31T00:27:06.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.894+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26580038c0 con 0x7f265c0b1d30 2023-08-31T00:27:06.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.894+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c0a6580 con 0x7f265c0b1d30 2023-08-31T00:27:06.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.894+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c0a6b40 con 0x7f265c0b1d30 2023-08-31T00:27:06.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.897+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2658003a20 con 0x7f265c0b1d30 2023-08-31T00:27:06.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.897+0000 7f2652ffd700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f264006a0e0 0x7f264006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.898+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2658087b50 con 0x7f265c0b1d30 2023-08-31T00:27:06.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.904+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26440052f0 con 0x7f265c0b1d30 2023-08-31T00:27:06.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.907+0000 7f2661a02700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f264006a0e0 0x7f264006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.907+0000 7f2661a02700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f264006a0e0 0x7f264006c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f265c070170 tx=0x7f264c0047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.913+0000 7fcc48e9d700 1 -- 172.21.15.77:0/3622020557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc4415a230 msgr2=0x7fcc4415a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.913+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/3622020557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc4415a230 0x7fcc4415a6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc34005fd0 tx=0x7fcc34009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.914+0000 7fcc48e9d700 1 -- 172.21.15.77:0/3622020557 shutdown_connections 2023-08-31T00:27:06.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.914+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/3622020557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc4415a230 0x7fcc4415a6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.914+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/3622020557 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc440c9b10 0x7fcc440cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.914+0000 7fcc48e9d700 1 -- 172.21.15.77:0/3622020557 >> 172.21.15.77:0/3622020557 conn(0x7fcc4406a4d0 msgr2=0x7fcc440aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.914+0000 7fcc48e9d700 1 -- 172.21.15.77:0/3622020557 shutdown_connections 2023-08-31T00:27:06.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.913+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2658053360 con 0x7f265c0b1d30 2023-08-31T00:27:06.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.914+0000 7fcc48e9d700 1 -- 172.21.15.77:0/3622020557 wait complete. 2023-08-31T00:27:06.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.916+0000 7fcc48e9d700 1 Processor -- start 2023-08-31T00:27:06.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.916+0000 7fcc48e9d700 1 -- start start 2023-08-31T00:27:06.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.917+0000 7fcc48e9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc440c9b10 0x7fcc4413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.917+0000 7fcc48e9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 0x7fcc4413c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.917+0000 7fcc48e9d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc4415a230 0x7fcc44154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.917+0000 7fcc48e9d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44150e70 con 0x7fcc440c9ef0 2023-08-31T00:27:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.917+0000 7fcc48e9d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4413ca30 con 0x7fcc440c9b10 2023-08-31T00:27:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.917+0000 7fcc48e9d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4413f9e0 con 0x7fcc4415a230 2023-08-31T00:27:06.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 0x7fcc4413c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 0x7fcc4413c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38764/0 (socket says 172.21.15.77:38764) 2023-08-31T00:27:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 -- 172.21.15.77:0/1731672789 learned_addr learned my addr 172.21.15.77:0/1731672789 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc4259c700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc440c9b10 0x7fcc4413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 -- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc4415a230 msgr2=0x7fcc44154db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:06.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc4415a230 0x7fcc44154db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 -- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc440c9b10 msgr2=0x7fcc4413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:06.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc440c9b10 0x7fcc4413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:06.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc41d9b700 1 -- 172.21.15.77:0/1731672789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340095f0 con 0x7fcc440c9ef0 2023-08-31T00:27:06.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.918+0000 7fcc4259c700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc440c9b10 0x7fcc4413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T00:27:06.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.919+0000 7fcc41d9b700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 0x7fcc4413c130 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800b580 tx=0x7fcc3800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:06.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.924+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38011830 con 0x7fcc440c9ef0 2023-08-31T00:27:06.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.924+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcc38011aa0 con 0x7fcc440c9ef0 2023-08-31T00:27:06.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.924+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38010380 con 0x7fcc440c9ef0 2023-08-31T00:27:06.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.924+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc441f9c60 con 0x7fcc440c9ef0 2023-08-31T00:27:06.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.924+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc441fa220 con 0x7fcc440c9ef0 2023-08-31T00:27:06.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.926+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc280052f0 con 0x7fcc440c9ef0 2023-08-31T00:27:06.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.937+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcc380104e0 con 0x7fcc440c9ef0 2023-08-31T00:27:06.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.937+0000 7fcc32ffd700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcc2406a180 0x7fcc2406c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:06.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.937+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc38088ac0 con 0x7fcc440c9ef0 2023-08-31T00:27:06.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.938+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcc380b4a30 con 0x7fcc440c9ef0 2023-08-31T00:27:06.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.945+0000 7fcc4259c700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcc2406a180 0x7fcc2406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:06.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:06.945+0000 7fcc4259c700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcc2406a180 0x7fcc2406c640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00b7d0 tx=0x7fcc3c00d040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:07.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.255+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2a94168a50 con 0x7f2a9415f0e0 2023-08-31T00:27:07.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.255+0000 7f2a917fa700 1 -- 172.21.15.77:0/588368078 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a8c017090 con 0x7f2a9415f0e0 2023-08-31T00:27:07.259 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:07.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2a8006a1b0 msgr2=0x7f2a8006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2a8006a1b0 0x7f2a8006c670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009660 tx=0x7f2a84006c00 comp rx=0 tx=0).stop 2023-08-31T00:27:07.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 msgr2=0x7f2a941514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 0x7f2a941514c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c7a0 tx=0x7f2a8c00cb60 comp rx=0 tx=0).stop 2023-08-31T00:27:07.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 shutdown_connections 2023-08-31T00:27:07.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2a8006a1b0 0x7f2a8006c670 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009660 tx=0x7f2a84006c00 comp rx=0 tx=0).stop 2023-08-31T00:27:07.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a9415f0e0 0x7f2a941514c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a940c9b10 0x7f2a9415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 --2- 172.21.15.77:0/588368078 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2a940c9ef0 0x7f2a94152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.259+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 >> 172.21.15.77:0/588368078 conn(0x7f2a9406a4d0 msgr2=0x7f2a940aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.260+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 shutdown_connections 2023-08-31T00:27:07.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.260+0000 7f2a9aacd700 1 -- 172.21.15.77:0/588368078 wait complete. 2023-08-31T00:27:07.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.267+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a8c0c16c0 con 0x7f7a8c0ab420 2023-08-31T00:27:07.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.270+0000 7f7a88ff9700 1 -- 172.21.15.77:0/2558170394 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a84056c80 con 0x7f7a8c0ab420 2023-08-31T00:27:07.274 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-08-31T00:27:07.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7a7806a130 msgr2=0x7f7a7806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7a7806a130 0x7f7a7806c5f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a80005950 tx=0x7f7a800058e0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 msgr2=0x7f7a8c157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 0x7f7a8c157c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400c8a0 tx=0x7f7a8400cc60 comp rx=0 tx=0).stop 2023-08-31T00:27:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 shutdown_connections 2023-08-31T00:27:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7a7806a130 0x7f7a7806c5f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7a8c0ab420 0x7f7a8c157c70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a8c06ad90 0x7f7a8c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 --2- 172.21.15.77:0/2558170394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a8c06b170 0x7f7a8c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.275+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 >> 172.21.15.77:0/2558170394 conn(0x7f7a8c070270 msgr2=0x7f7a8c15b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.276+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4d8c005160 con 0x7f4da406ceb0 2023-08-31T00:27:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.276+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 shutdown_connections 2023-08-31T00:27:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.276+0000 7f7a92325700 1 -- 172.21.15.77:0/2558170394 wait complete. 2023-08-31T00:27:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.277+0000 7f4d9affd700 1 -- 172.21.15.77:0/3070960644 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d94086e60 con 0x7f4da406ceb0 2023-08-31T00:27:07.280 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:07.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.4 2023-08-31T00:27:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f86640c14f0 con 0x7f866414bb50 2023-08-31T00:27:07.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4d8806a0b0 msgr2=0x7f4d8806c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4d8806a0b0 0x7f4d8806c570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4da4066610 tx=0x7f4da0019040 comp rx=0 tx=0).stop 2023-08-31T00:27:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 msgr2=0x7f4da414c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 0x7f4da414c7e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b480 tx=0x7f4d9400b840 comp rx=0 tx=0).stop 2023-08-31T00:27:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 shutdown_connections 2023-08-31T00:27:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4d8806a0b0 0x7f4d8806c570 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4da4158160 0x7f4da415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4da406ceb0 0x7f4da414c7e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 --2- 172.21.15.77:0/3070960644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da40cbec0 0x7f4da415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 >> 172.21.15.77:0/3070960644 conn(0x7f4da406a4d0 msgr2=0x7f4da40adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 shutdown_connections 2023-08-31T00:27:07.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.280+0000 7f4dac443700 1 -- 172.21.15.77:0/3070960644 wait complete. 2023-08-31T00:27:07.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.286+0000 7f8659ffb700 1 -- 172.21.15.77:0/1783962735 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f865c01f090 con 0x7f866414bb50 2023-08-31T00:27:07.290 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-08-31T00:27:07.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.287+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f036c005160 con 0x7f038c09ae00 2023-08-31T00:27:07.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.288+0000 7f0389ffb700 1 -- 172.21.15.77:0/65783752 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0380015030 con 0x7f038c09ae00 2023-08-31T00:27:07.291 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2023-08-31T00:27:07.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.290+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f864806a0e0 msgr2=0x7f864806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.290+0000 7f866b72f700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f864806a0e0 0x7f864806c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86640b2f60 tx=0x7f8660007a40 comp rx=0 tx=0).stop 2023-08-31T00:27:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.290+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 msgr2=0x7f866414b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.290+0000 7f866b72f700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 0x7f866414b3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f865c00ea00 tx=0x7f865c00ed10 comp rx=0 tx=0).stop 2023-08-31T00:27:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.291+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 shutdown_connections 2023-08-31T00:27:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.291+0000 7f866b72f700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f864806a0e0 0x7f864806c5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.291+0000 7f866b72f700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8650005030 0x7f8664155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.291+0000 7f866b72f700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86640ae360 0x7f86640ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.291+0000 7f866b72f700 1 --2- 172.21.15.77:0/1783962735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f866414bb50 0x7f866414b3a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.291+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 >> 172.21.15.77:0/1783962735 conn(0x7f8664070270 msgr2=0x7f866406d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 shutdown_connections 2023-08-31T00:27:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7f866b72f700 1 -- 172.21.15.77:0/1783962735 wait complete. 2023-08-31T00:27:07.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f037806a130 msgr2=0x7f037806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7f0393584700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f037806a130 0x7f037806c5f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0384001cb0 tx=0x7f038400f000 comp rx=0 tx=0).stop 2023-08-31T00:27:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 msgr2=0x7f038c0b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7f0393584700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 0x7f038c0b02e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f038000b580 tx=0x7f038000b890 comp rx=0 tx=0).stop 2023-08-31T00:27:07.296 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2023-08-31T00:27:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe64c005160 con 0x7fe66c1584e0 2023-08-31T00:27:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.292+0000 7fe661ffb700 1 -- 172.21.15.77:0/781309961 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe65c016030 con 0x7fe66c1584e0 2023-08-31T00:27:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 shutdown_connections 2023-08-31T00:27:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f037806a130 0x7f037806c5f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f038c0b0820 0x7f038c1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0374003a00 0x7f038c095ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 --2- 172.21.15.77:0/65783752 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f038c09ae00 0x7f038c0b02e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 >> 172.21.15.77:0/65783752 conn(0x7f038c0cd370 msgr2=0x7f038c0ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 shutdown_connections 2023-08-31T00:27:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.293+0000 7f0393584700 1 -- 172.21.15.77:0/65783752 wait complete. 2023-08-31T00:27:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.296+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe65006a0e0 msgr2=0x7fe65006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.296+0000 7fe6732e7700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe65006a0e0 0x7fe65006c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe668007fd0 tx=0x7fe668007e40 comp rx=0 tx=0).stop 2023-08-31T00:27:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.296+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 msgr2=0x7fe66c159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.296+0000 7fe6732e7700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 0x7fe66c159b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00d650 tx=0x7fe65c00d960 comp rx=0 tx=0).stop 2023-08-31T00:27:07.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2023-08-31T00:27:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.302+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 shutdown_connections 2023-08-31T00:27:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.302+0000 7fe6732e7700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe65006a0e0 0x7fe65006c5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.302+0000 7fe6732e7700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe66c153f00 0x7fe66c154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.302+0000 7fe6732e7700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe658005210 0x7fe66c156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.302+0000 7fe6732e7700 1 --2- 172.21.15.77:0/781309961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe66c1584e0 0x7fe66c159b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.302+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 >> 172.21.15.77:0/781309961 conn(0x7fe66c0cdd90 msgr2=0x7fe66c161ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.7 2023-08-31T00:27:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.304+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 shutdown_connections 2023-08-31T00:27:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.304+0000 7fe6732e7700 1 -- 172.21.15.77:0/781309961 wait complete. 2023-08-31T00:27:07.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2023-08-31T00:27:07.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2023-08-31T00:27:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.312+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26440055a0 con 0x7f265c0b1d30 2023-08-31T00:27:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.312+0000 7f2652ffd700 1 -- 172.21.15.77:0/1476126111 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2658056980 con 0x7f265c0b1d30 2023-08-31T00:27:07.313 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:07.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f264006a0e0 msgr2=0x7f264006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f264006a0e0 0x7f264006c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f265c070170 tx=0x7f264c0047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 msgr2=0x7f265c0a8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 0x7f265c0a8cc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f265800c500 tx=0x7f265800c8c0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 shutdown_connections 2023-08-31T00:27:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f264006a0e0 0x7f264006c5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f265c169360 0x7f265c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f265c0b1d30 0x7f265c0a8cc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 --2- 172.21.15.77:0/1476126111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f265c165d70 0x7f265c0a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 >> 172.21.15.77:0/1476126111 conn(0x7f265c06a4d0 msgr2=0x7f265c169ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 shutdown_connections 2023-08-31T00:27:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.315+0000 7f2664467700 1 -- 172.21.15.77:0/1476126111 wait complete. 2023-08-31T00:27:07.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.319+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc28005160 con 0x7fcc440c9ef0 2023-08-31T00:27:07.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.320+0000 7fcc32ffd700 1 -- 172.21.15.77:0/1731672789 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc38015020 con 0x7fcc440c9ef0 2023-08-31T00:27:07.321 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:07.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcc2406a180 msgr2=0x7fcc2406c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2023-08-31T00:27:07.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcc2406a180 0x7fcc2406c640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00b7d0 tx=0x7fcc3c00d040 comp rx=0 tx=0).stop 2023-08-31T00:27:07.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 msgr2=0x7fcc4413c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:07.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 0x7fcc4413c130 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800b580 tx=0x7fcc3800b890 comp rx=0 tx=0).stop 2023-08-31T00:27:07.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 shutdown_connections 2023-08-31T00:27:07.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcc2406a180 0x7fcc2406c640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcc4415a230 0x7fcc44154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcc440c9b10 0x7fcc4413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 --2- 172.21.15.77:0/1731672789 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc440c9ef0 0x7fcc4413c130 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:07.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 >> 172.21.15.77:0/1731672789 conn(0x7fcc4406a4d0 msgr2=0x7fcc440b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:07.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 shutdown_connections 2023-08-31T00:27:07.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:07.322+0000 7fcc48e9d700 1 -- 172.21.15.77:0/1731672789 wait complete. 2023-08-31T00:27:07.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2023-08-31T00:27:07.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.2 2023-08-31T00:27:08.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T00:27:08.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T00:27:08.306 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T00:27:08.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T00:27:08.311 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T00:27:08.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T00:27:08.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T00:27:08.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T00:27:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.495+0000 7fede4d5b700 1 -- 172.21.15.77:0/75554329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedc8004850 msgr2=0x7fedc8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.495+0000 7fede4d5b700 1 --2- 172.21.15.77:0/75554329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedc8004850 0x7fedc8004cd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fede006aa50 tx=0x7fedc8005880 comp rx=0 tx=0).stop 2023-08-31T00:27:08.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.496+0000 7fedded9d700 1 -- 172.21.15.77:0/75554329 reap_dead start 2023-08-31T00:27:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.496+0000 7fede4d5b700 1 -- 172.21.15.77:0/75554329 shutdown_connections 2023-08-31T00:27:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.496+0000 7fede4d5b700 1 -- 172.21.15.77:0/75554329 >> 172.21.15.77:0/75554329 conn(0x7fede006a4d0 msgr2=0x7fede00aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.501+0000 7fede4d5b700 1 -- 172.21.15.77:0/75554329 shutdown_connections 2023-08-31T00:27:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.501+0000 7fede4d5b700 1 -- 172.21.15.77:0/75554329 wait complete. 2023-08-31T00:27:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.502+0000 7fede4d5b700 1 Processor -- start 2023-08-31T00:27:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.503+0000 7fede4d5b700 1 -- start start 2023-08-31T00:27:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fede4d5b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 0x7fede014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fede4d5b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede015f410 0x7fede0150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fede4d5b700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fede0151cc0 0x7fede0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fede4d5b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede0152680 con 0x7fede015f030 2023-08-31T00:27:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fede4d5b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede01f2370 con 0x7fede015f410 2023-08-31T00:27:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fede4d5b700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede01f2650 con 0x7fede0151cc0 2023-08-31T00:27:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedde59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 0x7fede014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedddd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede015f410 0x7fede0150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedde59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 0x7fede014fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38778/0 (socket says 172.21.15.77:38778) 2023-08-31T00:27:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedde59c700 1 -- 172.21.15.77:0/658905204 learned_addr learned my addr 172.21.15.77:0/658905204 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedded9d700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fede0151cc0 0x7fede0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedde59c700 1 -- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fede0151cc0 msgr2=0x7fede0152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.504+0000 7fedde59c700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fede0151cc0 0x7fede0152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedde59c700 1 -- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede015f410 msgr2=0x7fede0150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedde59c700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede015f410 0x7fede0150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedde59c700 1 -- 172.21.15.77:0/658905204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede01f2930 con 0x7fede015f030 2023-08-31T00:27:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedde59c700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 0x7fede014fbd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fedd000c870 tx=0x7fedd000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0004a50 con 0x7fede015f030 2023-08-31T00:27:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fedd0004bd0 con 0x7fede015f030 2023-08-31T00:27:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0005020 con 0x7fede015f030 2023-08-31T00:27:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede01f2c10 con 0x7fede015f030 2023-08-31T00:27:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.505+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede01f2020 con 0x7fede015f030 2023-08-31T00:27:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.507+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede006e330 con 0x7fede015f030 2023-08-31T00:27:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.508+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedd0005180 con 0x7fede015f030 2023-08-31T00:27:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.508+0000 7fedceffd700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc006a0e0 0x7fedc006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.508+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedd00883a0 con 0x7fede015f030 2023-08-31T00:27:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.509+0000 7fedddd9b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc006a0e0 0x7fedc006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.510+0000 7fedddd9b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc006a0e0 0x7fedc006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fedd8014040 tx=0x7fedd8004b30 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.520+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fedd0053b60 con 0x7fede015f030 2023-08-31T00:27:08.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.541+0000 7efdf5f63700 1 -- 172.21.15.77:0/1965176346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00c9fb0 msgr2=0x7efdf0166470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.541+0000 7efdf5f63700 1 --2- 172.21.15.77:0/1965176346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00c9fb0 0x7efdf0166470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efde8009f60 tx=0x7efde8009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:08.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.541+0000 7efdf5f63700 1 -- 172.21.15.77:0/1965176346 shutdown_connections 2023-08-31T00:27:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.541+0000 7efdf5f63700 1 --2- 172.21.15.77:0/1965176346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf00c9fb0 0x7efdf0166470 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.541+0000 7efdf5f63700 1 -- 172.21.15.77:0/1965176346 >> 172.21.15.77:0/1965176346 conn(0x7efdf006a4d0 msgr2=0x7efdf00aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.541+0000 7efdf5f63700 1 -- 172.21.15.77:0/1965176346 shutdown_connections 2023-08-31T00:27:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.542+0000 7efdf5f63700 1 -- 172.21.15.77:0/1965176346 wait complete. 2023-08-31T00:27:08.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.544+0000 7efdf5f63700 1 Processor -- start 2023-08-31T00:27:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.544+0000 7efdf5f63700 1 -- start start 2023-08-31T00:27:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.544+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/3188460549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e0415a230 msgr2=0x7f1e0415a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.544+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/3188460549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e0415a230 0x7f1e0415a680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e040aea90 tx=0x7f1df4009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:08.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdf5f63700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdf0071960 0x7efdf0166330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdf5f63700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdf00c9fb0 0x7efdf006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdf5f63700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 0x7efdf014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdf5f63700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0154aa0 con 0x7efdf015b5e0 2023-08-31T00:27:08.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdf5f63700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0166870 con 0x7efdf0071960 2023-08-31T00:27:08.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdf5f63700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf014c4a0 con 0x7efdf00c9fb0 2023-08-31T00:27:08.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdeffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 0x7efdf014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdeffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 0x7efdf014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38804/0 (socket says 172.21.15.77:38804) 2023-08-31T00:27:08.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdeffff700 1 -- 172.21.15.77:0/3389110277 learned_addr learned my addr 172.21.15.77:0/3389110277 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efdef7fe700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdf0071960 0x7efdf0166330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.545+0000 7efde6ffd700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdf00c9fb0 0x7efdf006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdeffff700 1 -- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdf00c9fb0 msgr2=0x7efdf006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdeffff700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdf00c9fb0 0x7efdf006c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdeffff700 1 -- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdf0071960 msgr2=0x7efdf0166330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdeffff700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdf0071960 0x7efdf0166330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdeffff700 1 -- 172.21.15.77:0/3389110277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009c40 con 0x7efdf015b5e0 2023-08-31T00:27:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efde6ffd700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdf00c9fb0 0x7efdf006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdeffff700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 0x7efdf014f720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efde8007aa0 tx=0x7efde8007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800e040 con 0x7efdf015b5e0 2023-08-31T00:27:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf006ca00 con 0x7efdf015b5e0 2023-08-31T00:27:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf01543e0 con 0x7efdf015b5e0 2023-08-31T00:27:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efde801d680 con 0x7efdf015b5e0 2023-08-31T00:27:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.546+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde801da70 con 0x7efdf015b5e0 2023-08-31T00:27:08.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.548+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd40052f0 con 0x7efdf015b5e0 2023-08-31T00:27:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.548+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/3188460549 shutdown_connections 2023-08-31T00:27:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.548+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/3188460549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e0415a230 0x7f1e0415a680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.548+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/3188460549 >> v2:172.21.15.139:3300/0 conn(0x7f1e040c9ef0 0x7f1e040cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.548+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/3188460549 >> 172.21.15.77:0/3188460549 conn(0x7f1e0406a4d0 msgr2=0x7f1e040aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.549+0000 7fab59ed3700 1 -- 172.21.15.77:0/731876301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd710 msgr2=0x7fab5406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.549+0000 7fab59ed3700 1 --2- 172.21.15.77:0/731876301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd710 0x7fab5406d2e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab3c005fd0 tx=0x7fab3c009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7fab59ed3700 1 -- 172.21.15.77:0/731876301 shutdown_connections 2023-08-31T00:27:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7fab59ed3700 1 --2- 172.21.15.77:0/731876301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd710 0x7fab5406d2e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7fab59ed3700 1 -- 172.21.15.77:0/731876301 >> 172.21.15.77:0/731876301 conn(0x7fab54069d50 msgr2=0x7fab5406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7fab59ed3700 1 -- 172.21.15.77:0/731876301 shutdown_connections 2023-08-31T00:27:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.549+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efde801dbd0 con 0x7efdf015b5e0 2023-08-31T00:27:08.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7efdecff9700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7efdd006a0e0 0x7efdd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efde808a4d0 con 0x7efdf015b5e0 2023-08-31T00:27:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.551+0000 7efdef7fe700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7efdd006a0e0 0x7efdd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.551+0000 7efdef7fe700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7efdd006a0e0 0x7efdd006c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdd8001400 tx=0x7efdd8009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.550+0000 7fab59ed3700 1 -- 172.21.15.77:0/731876301 wait complete. 2023-08-31T00:27:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.552+0000 7fab59ed3700 1 Processor -- start 2023-08-31T00:27:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.552+0000 7fab59ed3700 1 -- start start 2023-08-31T00:27:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab59ed3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 0x7fab541fdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab59ed3700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab540cd710 0x7fab540aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab59ed3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab5415fb90 0x7fab540b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab59ed3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b0bb0 con 0x7fab540cd330 2023-08-31T00:27:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab59ed3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5415d900 con 0x7fab5415fb90 2023-08-31T00:27:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab59ed3700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5415dbe0 con 0x7fab540cd710 2023-08-31T00:27:08.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab537fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 0x7fab541fdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab537fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 0x7fab541fdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38818/0 (socket says 172.21.15.77:38818) 2023-08-31T00:27:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.553+0000 7fab537fe700 1 -- 172.21.15.77:0/861452184 learned_addr learned my addr 172.21.15.77:0/861452184 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fbb8b413700 1 -- 172.21.15.77:0/340699526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84165d70 msgr2=0x7fbb840afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fbb8b413700 1 --2- 172.21.15.77:0/340699526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84165d70 0x7fbb840afe00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009d60 tx=0x7fbb7400b540 comp rx=0 tx=0).stop 2023-08-31T00:27:08.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fab537fe700 1 -- 172.21.15.77:0/861452184 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab540cd710 msgr2=0x7fab540aef60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fab537fe700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab540cd710 0x7fab540aef60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fab537fe700 1 -- 172.21.15.77:0/861452184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab5415fb90 msgr2=0x7fab540b1680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T00:27:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fab537fe700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab5415fb90 0x7fab540b1680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fab537fe700 1 -- 172.21.15.77:0/861452184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c0095f0 con 0x7fab540cd330 2023-08-31T00:27:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fbb8b413700 1 -- 172.21.15.77:0/340699526 shutdown_connections 2023-08-31T00:27:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fbb8b413700 1 --2- 172.21.15.77:0/340699526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84165d70 0x7fbb840afe00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fbb8b413700 1 --2- 172.21.15.77:0/340699526 >> v2:172.21.15.77:3300/0 conn(0x7fbb84169360 0x7fbb840b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fbb8b413700 1 -- 172.21.15.77:0/340699526 >> 172.21.15.77:0/340699526 conn(0x7fbb8406a4d0 msgr2=0x7fbb840aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.554+0000 7fab537fe700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 0x7fab541fdee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c8c0 tx=0x7fab4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.555+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/3188460549 shutdown_connections 2023-08-31T00:27:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.555+0000 7fbb8b413700 1 -- 172.21.15.77:0/340699526 shutdown_connections 2023-08-31T00:27:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.555+0000 7fbb8b413700 1 -- 172.21.15.77:0/340699526 wait complete. 2023-08-31T00:27:08.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.555+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efde8055da0 con 0x7efdf015b5e0 2023-08-31T00:27:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44003e10 con 0x7fab540cd330 2023-08-31T00:27:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fab44005070 con 0x7fab540cd330 2023-08-31T00:27:08.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44005460 con 0x7fab540cd330 2023-08-31T00:27:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.556+0000 7f89f6e3e700 1 -- 172.21.15.77:0/1428895896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 msgr2=0x7f89f00cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.556+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/1428895896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00cadb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89f00cdfb0 tx=0x7f89e80082e0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5415dec0 con 0x7fab540cd330 2023-08-31T00:27:08.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5415e480 con 0x7fab540cd330 2023-08-31T00:27:08.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.555+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/3188460549 wait complete. 2023-08-31T00:27:08.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7f1e0a6cf700 1 Processor -- start 2023-08-31T00:27:08.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7fbb8b413700 1 Processor -- start 2023-08-31T00:27:08.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.558+0000 7f89f6e3e700 1 -- 172.21.15.77:0/1428895896 shutdown_connections 2023-08-31T00:27:08.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.558+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/1428895896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00cadb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.558+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/1428895896 >> v2:172.21.15.139:3300/0 conn(0x7f89f015a960 0x7f89f00cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.558+0000 7f89f6e3e700 1 -- 172.21.15.77:0/1428895896 >> 172.21.15.77:0/1428895896 conn(0x7f89f0069d50 msgr2=0x7f89f006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.558+0000 7f89f6e3e700 1 -- 172.21.15.77:0/1428895896 shutdown_connections 2023-08-31T00:27:08.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.557+0000 7f1e0a6cf700 1 -- start start 2023-08-31T00:27:08.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e0a6cf700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e040c9b10 0x7f1e04154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e0a6cf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e040c9ef0 0x7f1e041575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e0a6cf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0415a230 0x7f1e04201410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e0a6cf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04155b20 con 0x7f1e040c9ef0 2023-08-31T00:27:08.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e0a6cf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04157b30 con 0x7f1e0415a230 2023-08-31T00:27:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e0a6cf700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04154f10 con 0x7f1e040c9b10 2023-08-31T00:27:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e040c9ef0 0x7f1e041575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e037fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e040c9ef0 0x7f1e041575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38826/0 (socket says 172.21.15.77:38826) 2023-08-31T00:27:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e037fe700 1 -- 172.21.15.77:0/1932017156 learned_addr learned my addr 172.21.15.77:0/1932017156 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e03fff700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e040c9b10 0x7f1e04154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f1e08c6c700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0415a230 0x7f1e04201410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.560+0000 7f1e03fff700 1 -- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0415a230 msgr2=0x7f1e04201410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.560+0000 7f1e03fff700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0415a230 0x7f1e04201410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.560+0000 7f1e03fff700 1 -- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e040c9ef0 msgr2=0x7f1e041575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.560+0000 7f1e03fff700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e040c9ef0 0x7f1e041575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.560+0000 7f1e03fff700 1 -- 172.21.15.77:0/1932017156 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40095f0 con 0x7f1e040c9b10 2023-08-31T00:27:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.560+0000 7f1e03fff700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e040c9b10 0x7f1e04154880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00bd50 tx=0x7f1dfc00bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc00c9b0 con 0x7f1e040c9b10 2023-08-31T00:27:08.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1dfc00cc00 con 0x7f1e040c9b10 2023-08-31T00:27:08.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.559+0000 7f89f6e3e700 1 -- 172.21.15.77:0/1428895896 wait complete. 2023-08-31T00:27:08.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f89f6e3e700 1 Processor -- start 2023-08-31T00:27:08.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab440055c0 con 0x7fab540cd330 2023-08-31T00:27:08.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7fab50ff9700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fab4006a310 0x7fab4006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab44087df0 con 0x7fab540cd330 2023-08-31T00:27:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc014440 con 0x7f1e040c9b10 2023-08-31T00:27:08.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e040701b0 con 0x7f1e040c9b10 2023-08-31T00:27:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e041554d0 con 0x7f1e040c9b10 2023-08-31T00:27:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e04073c30 con 0x7f1e040c9b10 2023-08-31T00:27:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.561+0000 7f89f6e3e700 1 -- start start 2023-08-31T00:27:08.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89f6e3e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f006d170 0x7f89f015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89f6e3e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89f6e3e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89f015a960 0x7f89f0152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89f6e3e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00b0d00 con 0x7f89f0071840 2023-08-31T00:27:08.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89f6e3e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015d1f0 con 0x7f89f006d170 2023-08-31T00:27:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89f6e3e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015d4d0 con 0x7f89f015a960 2023-08-31T00:27:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89effff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89effff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38834/0 (socket says 172.21.15.77:38834) 2023-08-31T00:27:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.562+0000 7f89effff700 1 -- 172.21.15.77:0/744336651 learned_addr learned my addr 172.21.15.77:0/744336651 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89f4bda700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f006d170 0x7f89f015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89f53db700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89f015a960 0x7f89f0152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89effff700 1 -- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89f015a960 msgr2=0x7f89f0152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89effff700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89f015a960 0x7f89f0152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89effff700 1 -- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f006d170 msgr2=0x7f89f015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89effff700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f006d170 0x7f89f015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89effff700 1 -- 172.21.15.77:0/744336651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8007ce0 con 0x7f89f0071840 2023-08-31T00:27:08.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89f53db700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89f015a960 0x7f89f0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:08.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1dfc01d3b0 con 0x7f1e040c9b10 2023-08-31T00:27:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7f1e00ff9700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1de806a100 0x7f1de806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dfc0881c0 con 0x7f1e040c9b10 2023-08-31T00:27:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7fbb8b413700 1 -- start start 2023-08-31T00:27:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb8b413700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb840b1d30 0x7fbb842125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb8b413700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb84165d70 0x7fbb840a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb8b413700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84169360 0x7fbb8416a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb8b413700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8406d9a0 con 0x7fbb84165d70 2023-08-31T00:27:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb8b413700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8406cd20 con 0x7fbb840b1d30 2023-08-31T00:27:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb8b413700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8406d000 con 0x7fbb84169360 2023-08-31T00:27:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7fbb891af700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb840b1d30 0x7fbb842125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb891af700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb840b1d30 0x7fbb842125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.77:50392/0 (socket says 172.21.15.77:50392) 2023-08-31T00:27:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb891af700 1 -- 172.21.15.77:0/627185304 learned_addr learned my addr 172.21.15.77:0/627185304 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84169360 0x7fbb8416a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.563+0000 7f89effff700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00b07c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89e000b450 tx=0x7f89e000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011830 con 0x7f89f0071840 2023-08-31T00:27:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f89e00119b0 con 0x7f89f0071840 2023-08-31T00:27:08.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.564+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011dc0 con 0x7f89f0071840 2023-08-31T00:27:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 -- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb840b1d30 msgr2=0x7fbb842125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb840b1d30 0x7fbb842125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 -- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb84165d70 msgr2=0x7fbb840a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb84165d70 0x7fbb840a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 -- 172.21.15.77:0/627185304 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740094c0 con 0x7fbb84169360 2023-08-31T00:27:08.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7fbb899b0700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84169360 0x7fbb8416a9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00ca20 tx=0x7fbb7c00cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.566+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab380052f0 con 0x7fab540cd330 2023-08-31T00:27:08.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.566+0000 7fab4affd700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fab4006a310 0x7fab4006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.566+0000 7fab4affd700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fab4006a310 0x7fab4006c7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab3c005fd0 tx=0x7fab3c0047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f015d7b0 con 0x7f89f0071840 2023-08-31T00:27:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.565+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f015dd70 con 0x7f89f0071840 2023-08-31T00:27:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.567+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89e001a400 con 0x7f89f0071840 2023-08-31T00:27:08.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.568+0000 7f1e037fe700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1de806a100 0x7f1de806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.568+0000 7f89ed7fa700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f89dc06a290 0x7f89dc06c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.568+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89e0088560 con 0x7f89f0071840 2023-08-31T00:27:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.568+0000 7f89f4bda700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f89dc06a290 0x7f89dc06c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.568+0000 7f1e037fe700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1de806a100 0x7f1de806c5c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e040aea40 tx=0x7f1df8009210 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.568+0000 7f89f4bda700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f89dc06a290 0x7f89dc06c750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89f0152c40 tx=0x7f89d800f040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.569+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1dfc053ba0 con 0x7f1e040c9b10 2023-08-31T00:27:08.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.572+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d40052f0 con 0x7f89f0071840 2023-08-31T00:27:08.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.580+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c003c00 con 0x7fbb84169360 2023-08-31T00:27:08.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.580+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb7c003e50 con 0x7fbb84169360 2023-08-31T00:27:08.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.580+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00aa40 con 0x7fbb84169360 2023-08-31T00:27:08.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.581+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8406d2e0 con 0x7fbb84169360 2023-08-31T00:27:08.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.581+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb840a99a0 con 0x7fbb84169360 2023-08-31T00:27:08.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.583+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb7c00aba0 con 0x7fbb84169360 2023-08-31T00:27:08.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.584+0000 7fbb79ffb700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbb6806a130 0x7fbb6806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.584+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8406dae0 con 0x7fbb84169360 2023-08-31T00:27:08.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.584+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb7c088130 con 0x7fbb84169360 2023-08-31T00:27:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.585+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f89e0053db0 con 0x7f89f0071840 2023-08-31T00:27:08.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.585+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fab44053660 con 0x7fab540cd330 2023-08-31T00:27:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.589+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbb8406dae0 con 0x7fbb84169360 2023-08-31T00:27:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.589+0000 7fbb891af700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbb6806a130 0x7fbb6806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.589+0000 7fbb891af700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbb6806a130 0x7fbb6806c5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009cb0 tx=0x7fbb740047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.620+0000 7f2df7eb8700 1 -- 172.21.15.77:0/2173011175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00cb7c0 msgr2=0x7f2df015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.620+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/2173011175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00cb7c0 0x7f2df015a940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009840 tx=0x7f2dec009b50 comp rx=0 tx=0).stop 2023-08-31T00:27:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.621+0000 7f2df7eb8700 1 -- 172.21.15.77:0/2173011175 shutdown_connections 2023-08-31T00:27:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.621+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/2173011175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00cb7c0 0x7f2df015a940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.621+0000 7f2df7eb8700 1 -- 172.21.15.77:0/2173011175 >> 172.21.15.77:0/2173011175 conn(0x7f2df006a4d0 msgr2=0x7f2df00aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.621+0000 7f2df7eb8700 1 -- 172.21.15.77:0/2173011175 shutdown_connections 2023-08-31T00:27:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.621+0000 7f2df7eb8700 1 -- 172.21.15.77:0/2173011175 wait complete. 2023-08-31T00:27:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.623+0000 7f2df7eb8700 1 Processor -- start 2023-08-31T00:27:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.623+0000 7f2df7eb8700 1 -- start start 2023-08-31T00:27:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df7eb8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2df00c9b10 0x7f2df0151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df7eb8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 0x7f2df013e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df7eb8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2df00cb7c0 0x7f2df00aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df7eb8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00af060 con 0x7f2df00c9ef0 2023-08-31T00:27:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df7eb8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00aeaa0 con 0x7f2df00cb7c0 2023-08-31T00:27:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df7eb8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df00aed80 con 0x7f2df00c9b10 2023-08-31T00:27:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df5453700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 0x7f2df013e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df5453700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 0x7f2df013e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38856/0 (socket says 172.21.15.77:38856) 2023-08-31T00:27:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.624+0000 7f2df5453700 1 -- 172.21.15.77:0/946628448 learned_addr learned my addr 172.21.15.77:0/946628448 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5c54700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2df00c9b10 0x7f2df0151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df6455700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2df00cb7c0 0x7f2df00aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5453700 1 -- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2df00c9b10 msgr2=0x7f2df0151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5453700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2df00c9b10 0x7f2df0151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5453700 1 -- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2df00cb7c0 msgr2=0x7f2df00aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5453700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2df00cb7c0 0x7f2df00aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5453700 1 -- 172.21.15.77:0/946628448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec009520 con 0x7f2df00c9ef0 2023-08-31T00:27:08.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.625+0000 7f2df5453700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 0x7f2df013e7c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001e70 tx=0x7f2de000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.626+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00052e0 con 0x7f2df00c9ef0 2023-08-31T00:27:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.626+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2de0005440 con 0x7f2df00c9ef0 2023-08-31T00:27:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.626+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00038e0 con 0x7f2df00c9ef0 2023-08-31T00:27:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.626+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df0158890 con 0x7f2df00c9ef0 2023-08-31T00:27:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.626+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df013ed00 con 0x7f2df00c9ef0 2023-08-31T00:27:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.631+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd80052f0 con 0x7f2df00c9ef0 2023-08-31T00:27:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.631+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2de0003a40 con 0x7f2df00c9ef0 2023-08-31T00:27:08.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.632+0000 7f2de67fc700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2dd406a1b0 0x7f2dd406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.632+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2de00a9880 con 0x7f2df00c9ef0 2023-08-31T00:27:08.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.632+0000 7f2df5c54700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2dd406a1b0 0x7f2dd406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.633+0000 7f2df5c54700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2dd406a1b0 0x7f2dd406c670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001f80 tx=0x7f2de8009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.640+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2de00750d0 con 0x7f2df00c9ef0 2023-08-31T00:27:08.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.650+0000 7f252cd07700 1 -- 172.21.15.77:0/2940277382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 msgr2=0x7f25280cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.650+0000 7f252cd07700 1 --2- 172.21.15.77:0/2940277382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 0x7f25280cb7c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f25180098c0 tx=0x7f2518009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.651+0000 7f252cd07700 1 -- 172.21.15.77:0/2940277382 shutdown_connections 2023-08-31T00:27:08.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.651+0000 7f252cd07700 1 --2- 172.21.15.77:0/2940277382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f252815a230 0x7f252815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.651+0000 7f252cd07700 1 --2- 172.21.15.77:0/2940277382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 0x7f25280cb7c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.651+0000 7f252cd07700 1 -- 172.21.15.77:0/2940277382 >> 172.21.15.77:0/2940277382 conn(0x7f252806a4d0 msgr2=0x7f25280aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.651+0000 7f252cd07700 1 -- 172.21.15.77:0/2940277382 shutdown_connections 2023-08-31T00:27:08.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.651+0000 7f252cd07700 1 -- 172.21.15.77:0/2940277382 wait complete. 2023-08-31T00:27:08.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.653+0000 7f252cd07700 1 Processor -- start 2023-08-31T00:27:08.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.653+0000 7f252cd07700 1 -- start start 2023-08-31T00:27:08.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.654+0000 7f252cd07700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 0x7f2528150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.654+0000 7f252cd07700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 0x7f25281538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.654+0000 7f252cd07700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f252815a230 0x7f2528153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.654+0000 7f252cd07700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528150950 con 0x7f25280c9b10 2023-08-31T00:27:08.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.654+0000 7f252cd07700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252806c9d0 con 0x7f25280c9ef0 2023-08-31T00:27:08.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.654+0000 7f252cd07700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252806ccb0 con 0x7f252815a230 2023-08-31T00:27:08.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.655+0000 7f252659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 0x7f2528150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.655+0000 7f252659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 0x7f2528150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38870/0 (socket says 172.21.15.77:38870) 2023-08-31T00:27:08.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.655+0000 7f252659c700 1 -- 172.21.15.77:0/504226924 learned_addr learned my addr 172.21.15.77:0/504226924 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:08.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f2525d9b700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 0x7f25281538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f252659c700 1 -- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f252815a230 msgr2=0x7f2528153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f252659c700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f252815a230 0x7f2528153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f252659c700 1 -- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 msgr2=0x7f25281538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f252659c700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 0x7f25281538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f252659c700 1 -- 172.21.15.77:0/504226924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009520 con 0x7f25280c9b10 2023-08-31T00:27:08.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.656+0000 7f252659c700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 0x7f2528150410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c780 tx=0x7f251c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.657+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c005500 con 0x7f25280c9b10 2023-08-31T00:27:08.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.657+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f251c003680 con 0x7f25280c9b10 2023-08-31T00:27:08.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.657+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c003a90 con 0x7f25280c9b10 2023-08-31T00:27:08.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.657+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252806cf90 con 0x7f25280c9b10 2023-08-31T00:27:08.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.657+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252806d550 con 0x7f25280c9b10 2023-08-31T00:27:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.662+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f251c003bf0 con 0x7f25280c9b10 2023-08-31T00:27:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.662+0000 7f2516ffd700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251006a2c0 0x7f251006c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.663+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f251c0881b0 con 0x7f25280c9b10 2023-08-31T00:27:08.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.663+0000 7f2525d9b700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251006a2c0 0x7f251006c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:08.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.664+0000 7f2525d9b700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251006a2c0 0x7f251006c780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25180098c0 tx=0x7f2518019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:08.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.674+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c0052f0 con 0x7f25280c9b10 2023-08-31T00:27:08.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.683+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f251c053a00 con 0x7f25280c9b10 2023-08-31T00:27:08.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.897+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fede00afde0 con 0x7fede015f030 2023-08-31T00:27:08.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.899+0000 7fedceffd700 1 -- 172.21.15.77:0/658905204 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fede00afde0 con 0x7fede015f030 2023-08-31T00:27:08.902 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:08.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.902+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc006a0e0 msgr2=0x7fedc006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.902+0000 7fede4d5b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc006a0e0 0x7fedc006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fedd8014040 tx=0x7fedd8004b30 comp rx=0 tx=0).stop 2023-08-31T00:27:08.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.902+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 msgr2=0x7fede014fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.902+0000 7fede4d5b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 0x7fede014fbd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fedd000c870 tx=0x7fedd000cb80 comp rx=0 tx=0).stop 2023-08-31T00:27:08.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 shutdown_connections 2023-08-31T00:27:08.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc006a0e0 0x7fedc006c5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fede0151cc0 0x7fede0152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fede015f030 0x7fede014fbd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 --2- 172.21.15.77:0/658905204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fede015f410 0x7fede0150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 >> 172.21.15.77:0/658905204 conn(0x7fede006a4d0 msgr2=0x7fede00ab7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 shutdown_connections 2023-08-31T00:27:08.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.903+0000 7fede4d5b700 1 -- 172.21.15.77:0/658905204 wait complete. 2023-08-31T00:27:08.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-08-31T00:27:08.922 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:08.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.959+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fab380055a0 con 0x7fab540cd330 2023-08-31T00:27:08.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.960+0000 7fab50ff9700 1 -- 172.21.15.77:0/861452184 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab44017070 con 0x7fab540cd330 2023-08-31T00:27:08.961 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:08.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.962+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fab4006a310 msgr2=0x7fab4006c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.962+0000 7fab59ed3700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fab4006a310 0x7fab4006c7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab3c005fd0 tx=0x7fab3c0047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.962+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 msgr2=0x7fab541fdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.962+0000 7fab59ed3700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 0x7fab541fdee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c8c0 tx=0x7fab4400cc80 comp rx=0 tx=0).stop 2023-08-31T00:27:08.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.962+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efdd4005870 con 0x7efdf015b5e0 2023-08-31T00:27:08.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 shutdown_connections 2023-08-31T00:27:08.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fab4006a310 0x7fab4006c7d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab5415fb90 0x7fab540b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab540cd330 0x7fab541fdee0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 --2- 172.21.15.77:0/861452184 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fab540cd710 0x7fab540aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 >> 172.21.15.77:0/861452184 conn(0x7fab54069d50 msgr2=0x7fab5406a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7efdecff9700 1 -- 172.21.15.77:0/3389110277 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efde80593c0 con 0x7efdf015b5e0 2023-08-31T00:27:08.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1e04070000 con 0x7f1e040c9b10 2023-08-31T00:27:08.966 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:08.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 shutdown_connections 2023-08-31T00:27:08.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7fab59ed3700 1 -- 172.21.15.77:0/861452184 wait complete. 2023-08-31T00:27:08.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.963+0000 7f1e00ff9700 1 -- 172.21.15.77:0/1932017156 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dfc019020 con 0x7f1e040c9b10 2023-08-31T00:27:08.968 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2023-08-31T00:27:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7efdd006a0e0 msgr2=0x7efdd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7efdd006a0e0 0x7efdd006c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdd8001400 tx=0x7efdd8009040 comp rx=0 tx=0).stop 2023-08-31T00:27:08.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 msgr2=0x7efdf014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 0x7efdf014f720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efde8007aa0 tx=0x7efde8007b80 comp rx=0 tx=0).stop 2023-08-31T00:27:08.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 shutdown_connections 2023-08-31T00:27:08.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7efdd006a0e0 0x7efdd006c5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdf015b5e0 0x7efdf014f720 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdf0071960 0x7efdf0166330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 --2- 172.21.15.77:0/3389110277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdf00c9fb0 0x7efdf006c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.966+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 >> 172.21.15.77:0/3389110277 conn(0x7efdf006a4d0 msgr2=0x7efdf00ad640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.967+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 shutdown_connections 2023-08-31T00:27:08.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.967+0000 7efdf5f63700 1 -- 172.21.15.77:0/3389110277 wait complete. 2023-08-31T00:27:08.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1de806a100 msgr2=0x7f1de806c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1de806a100 0x7f1de806c5c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e040aea40 tx=0x7f1df8009210 comp rx=0 tx=0).stop 2023-08-31T00:27:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e040c9b10 msgr2=0x7f1e04154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e040c9b10 0x7f1e04154880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00bd50 tx=0x7f1dfc00bd80 comp rx=0 tx=0).stop 2023-08-31T00:27:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 shutdown_connections 2023-08-31T00:27:08.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1de806a100 0x7f1de806c5c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e040c9b10 0x7f1e04154880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e0415a230 0x7f1e04201410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 --2- 172.21.15.77:0/1932017156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e040c9ef0 0x7f1e041575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 >> 172.21.15.77:0/1932017156 conn(0x7f1e0406a4d0 msgr2=0x7f1e0406db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 shutdown_connections 2023-08-31T00:27:08.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.969+0000 7f1e0a6cf700 1 -- 172.21.15.77:0/1932017156 wait complete. 2023-08-31T00:27:08.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-08-31T00:27:08.984 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:08.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-08-31T00:27:08.989 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:08.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.989+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89d40055a0 con 0x7f89f0071840 2023-08-31T00:27:08.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.990+0000 7f89ed7fa700 1 -- 172.21.15.77:0/744336651 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89e0015020 con 0x7f89f0071840 2023-08-31T00:27:08.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-08-31T00:27:08.992 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:08.993 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:08.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.991+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb8406dae0 con 0x7fbb84169360 2023-08-31T00:27:08.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7fbb79ffb700 1 -- 172.21.15.77:0/627185304 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb8406dae0 con 0x7fbb84169360 2023-08-31T00:27:08.994 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2023-08-31T00:27:08.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f89dc06a290 msgr2=0x7f89dc06c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f89dc06a290 0x7f89dc06c750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89f0152c40 tx=0x7f89d800f040 comp rx=0 tx=0).stop 2023-08-31T00:27:08.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 msgr2=0x7f89f00b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00b07c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89e000b450 tx=0x7f89e000b760 comp rx=0 tx=0).stop 2023-08-31T00:27:08.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 shutdown_connections 2023-08-31T00:27:08.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f89dc06a290 0x7f89dc06c750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f89f015a960 0x7f89f0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89f006d170 0x7f89f015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 --2- 172.21.15.77:0/744336651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89f0071840 0x7f89f00b07c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 >> 172.21.15.77:0/744336651 conn(0x7f89f0069d50 msgr2=0x7f89f0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:08.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 shutdown_connections 2023-08-31T00:27:08.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.992+0000 7f89f6e3e700 1 -- 172.21.15.77:0/744336651 wait complete. 2023-08-31T00:27:08.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbb6806a130 msgr2=0x7fbb6806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbb6806a130 0x7fbb6806c5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009cb0 tx=0x7fbb740047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:08.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84169360 msgr2=0x7fbb8416a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:08.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84169360 0x7fbb8416a9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c00ca20 tx=0x7fbb7c00cd30 comp rx=0 tx=0).stop 2023-08-31T00:27:08.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 shutdown_connections 2023-08-31T00:27:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbb6806a130 0x7fbb6806c5f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbb84169360 0x7fbb8416a9e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb840b1d30 0x7fbb842125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 --2- 172.21.15.77:0/627185304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb84165d70 0x7fbb840a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 >> 172.21.15.77:0/627185304 conn(0x7fbb8406a4d0 msgr2=0x7fbb84169a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 shutdown_connections 2023-08-31T00:27:09.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:08.995+0000 7fbb8b413700 1 -- 172.21.15.77:0/627185304 wait complete. 2023-08-31T00:27:09.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-08-31T00:27:09.006 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:09.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-08-31T00:27:09.014 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:09.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.028+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dd8005160 con 0x7f2df00c9ef0 2023-08-31T00:27:09.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.028+0000 7f2de67fc700 1 -- 172.21.15.77:0/946628448 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2de00786f0 con 0x7f2df00c9ef0 2023-08-31T00:27:09.029 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:09.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2dd406a1b0 msgr2=0x7f2dd406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2dd406a1b0 0x7f2dd406c670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2de8001f80 tx=0x7f2de8009040 comp rx=0 tx=0).stop 2023-08-31T00:27:09.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 msgr2=0x7f2df013e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 0x7f2df013e7c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2de0001e70 tx=0x7f2de000c9b0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 shutdown_connections 2023-08-31T00:27:09.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2dd406a1b0 0x7f2dd406c670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2df00c9b10 0x7f2df0151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2df00cb7c0 0x7f2df00aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 --2- 172.21.15.77:0/946628448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2df00c9ef0 0x7f2df013e7c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 >> 172.21.15.77:0/946628448 conn(0x7f2df006a4d0 msgr2=0x7f2df0150670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 shutdown_connections 2023-08-31T00:27:09.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.030+0000 7f2df7eb8700 1 -- 172.21.15.77:0/946628448 wait complete. 2023-08-31T00:27:09.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.037+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f250c0055a0 con 0x7f25280c9b10 2023-08-31T00:27:09.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.038+0000 7f2516ffd700 1 -- 172.21.15.77:0/504226924 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f251c057020 con 0x7f25280c9b10 2023-08-31T00:27:09.038 INFO:teuthology.orchestra.run.smithi077.stdout:55834574857 2023-08-31T00:27:09.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251006a2c0 msgr2=0x7f251006c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251006a2c0 0x7f251006c780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25180098c0 tx=0x7f2518019040 comp rx=0 tx=0).stop 2023-08-31T00:27:09.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 msgr2=0x7f2528150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 0x7f2528150410 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c780 tx=0x7f251c00cb40 comp rx=0 tx=0).stop 2023-08-31T00:27:09.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 shutdown_connections 2023-08-31T00:27:09.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251006a2c0 0x7f251006c780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f252815a230 0x7f2528153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25280c9b10 0x7f2528150410 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 --2- 172.21.15.77:0/504226924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25280c9ef0 0x7f25281538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 >> 172.21.15.77:0/504226924 conn(0x7f252806a4d0 msgr2=0x7f25280aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 shutdown_connections 2023-08-31T00:27:09.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.040+0000 7f252cd07700 1 -- 172.21.15.77:0/504226924 wait complete. 2023-08-31T00:27:09.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-08-31T00:27:09.045 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:09.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-08-31T00:27:09.053 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:09.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T00:27:09.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:27:09.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7d1c80700 1 -- 172.21.15.77:0/16225341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 msgr2=0x7fa7b400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/16225341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7b400ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0711a0 tx=0x7fa7b4005880 comp rx=0 tx=0).stop 2023-08-31T00:27:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7cbfff700 1 -- 172.21.15.77:0/16225341 reap_dead start 2023-08-31T00:27:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7d1c80700 1 -- 172.21.15.77:0/16225341 shutdown_connections 2023-08-31T00:27:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7d1c80700 1 -- 172.21.15.77:0/16225341 >> 172.21.15.77:0/16225341 conn(0x7fa7cc070270 msgr2=0x7fa7cc070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7d1c80700 1 -- 172.21.15.77:0/16225341 shutdown_connections 2023-08-31T00:27:09.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.216+0000 7fa7d1c80700 1 -- 172.21.15.77:0/16225341 wait complete. 2023-08-31T00:27:09.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.217+0000 7fa7d1c80700 1 Processor -- start 2023-08-31T00:27:09.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.217+0000 7fa7d1c80700 1 -- start start 2023-08-31T00:27:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7cc1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7cc1592a0 0x7fa7cc151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7cc159700 0x7fa7cc151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc154eb0 con 0x7fa7b4005210 2023-08-31T00:27:09.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc15ad40 con 0x7fa7cc1592a0 2023-08-31T00:27:09.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc159ca0 con 0x7fa7cc159700 2023-08-31T00:27:09.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7cc1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7cc1540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38890/0 (socket says 172.21.15.77:38890) 2023-08-31T00:27:09.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 -- 172.21.15.77:0/458662536 learned_addr learned my addr 172.21.15.77:0/458662536 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:09.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7caffd700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7cc1592a0 0x7fa7cc151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cbfff700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7cc159700 0x7fa7cc151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 -- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7cc159700 msgr2=0x7fa7cc151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7cc159700 0x7fa7cc151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 -- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7cc1592a0 msgr2=0x7fa7cc151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7cc1592a0 0x7fa7cc151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 -- 172.21.15.77:0/458662536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc159f80 con 0x7fa7b4005210 2023-08-31T00:27:09.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cbfff700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7cc159700 0x7fa7cc151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:09.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7caffd700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7cc1592a0 0x7fa7cc151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:09.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7cb7fe700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7cc1540c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000e650 tx=0x7fa7c000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:09.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0010890 con 0x7fa7b4005210 2023-08-31T00:27:09.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa7c0010ae0 con 0x7fa7b4005210 2023-08-31T00:27:09.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0011460 con 0x7fa7b4005210 2023-08-31T00:27:09.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc15a260 con 0x7fa7b4005210 2023-08-31T00:27:09.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.218+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc15a820 con 0x7fa7b4005210 2023-08-31T00:27:09.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.219+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc073c30 con 0x7fa7b4005210 2023-08-31T00:27:09.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.220+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7c00115c0 con 0x7fa7b4005210 2023-08-31T00:27:09.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.220+0000 7fa7b3fff700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa7b806a0e0 0x7fa7b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.220+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c0088a60 con 0x7fa7b4005210 2023-08-31T00:27:09.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.220+0000 7fa7caffd700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa7b806a0e0 0x7fa7b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.220+0000 7fa7caffd700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa7b806a0e0 0x7fa7b806c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc06b6b0 tx=0x7fa7bc009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:09.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.224+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7c0054300 con 0x7fa7b4005210 2023-08-31T00:27:09.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.410+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7cc065c80 con 0x7fa7b806a0e0 2023-08-31T00:27:09.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.417+0000 7fa7b3fff700 1 -- 172.21.15.77:0/458662536 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264605 (secure 0 0 0) 0x7fa7cc065c80 con 0x7fa7b806a0e0 2023-08-31T00:27:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:09.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa7b806a0e0 msgr2=0x7fa7b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa7b806a0e0 0x7fa7b806c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc06b6b0 tx=0x7fa7bc009260 comp rx=0 tx=0).stop 2023-08-31T00:27:09.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 msgr2=0x7fa7cc1540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7cc1540c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000e650 tx=0x7fa7c000ea10 comp rx=0 tx=0).stop 2023-08-31T00:27:09.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 shutdown_connections 2023-08-31T00:27:09.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa7b806a0e0 0x7fa7b806c5a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa7cc159700 0x7fa7cc151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7b4005210 0x7fa7cc1540c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 --2- 172.21.15.77:0/458662536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7cc1592a0 0x7fa7cc151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 >> 172.21.15.77:0/458662536 conn(0x7fa7cc070270 msgr2=0x7fa7cc070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 shutdown_connections 2023-08-31T00:27:09.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.420+0000 7fa7d1c80700 1 -- 172.21.15.77:0/458662536 wait complete. 2023-08-31T00:27:09.425 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:27:09.433 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T00:27:08.118040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001828"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741205+0000","last_change":"2023-08-31T00:27:00.316606+0000","last_active":"2023-08-31T00:27:01.741205+0000","last_peered":"2023-08-31T00:27:01.741205+0000","last_clean":"2023-08-31T00:27:01.741205+0000","last_became_active":"2023-08-31T00:27:00.316335+0000","last_became_peered":"2023-08-31T00:27:00.316335+0000","last_unstale":"2023-08-31T00:27:01.741205+0000","last_undegraded":"2023-08-31T00:27:01.741205+0000","last_fullsized":"2023-08-31T00:27:01.741205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:40:38.763036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.300109+0000","last_change":"2023-08-31T00:27:00.319751+0000","last_active":"2023-08-31T00:27:01.300109+0000","last_peered":"2023-08-31T00:27:01.300109+0000","last_clean":"2023-08-31T00:27:01.300109+0000","last_became_active":"2023-08-31T00:27:00.319480+0000","last_became_peered":"2023-08-31T00:27:00.319480+0000","last_unstale":"2023-08-31T00:27:01.300109+0000","last_undegraded":"2023-08-31T00:27:01.300109+0000","last_fullsized":"2023-08-31T00:27:01.300109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741111+0000","last_change":"2023-08-31T00:27:00.314460+0000","last_active":"2023-08-31T00:27:01.741111+0000","last_peered":"2023-08-31T00:27:01.741111+0000","last_clean":"2023-08-31T00:27:01.741111+0000","last_became_active":"2023-08-31T00:27:00.314165+0000","last_became_peered":"2023-08-31T00:27:00.314165+0000","last_unstale":"2023-08-31T00:27:01.741111+0000","last_undegraded":"2023-08-31T00:27:01.741111+0000","last_fullsized":"2023-08-31T00:27:01.741111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741342+0000","last_change":"2023-08-31T00:27:00.330366+0000","last_active":"2023-08-31T00:27:01.741342+0000","last_peered":"2023-08-31T00:27:01.741342+0000","last_clean":"2023-08-31T00:27:01.741342+0000","last_became_active":"2023-08-31T00:27:00.330034+0000","last_became_peered":"2023-08-31T00:27:00.330034+0000","last_unstale":"2023-08-31T00:27:01.741342+0000","last_undegraded":"2023-08-31T00:27:01.741342+0000","last_fullsized":"2023-08-31T00:27:01.741342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:02:32.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740734+0000","last_change":"2023-08-31T00:27:00.315980+0000","last_active":"2023-08-31T00:27:01.740734+0000","last_peered":"2023-08-31T00:27:01.740734+0000","last_clean":"2023-08-31T00:27:01.740734+0000","last_became_active":"2023-08-31T00:27:00.315408+0000","last_became_peered":"2023-08-31T00:27:00.315408+0000","last_unstale":"2023-08-31T00:27:01.740734+0000","last_undegraded":"2023-08-31T00:27:01.740734+0000","last_fullsized":"2023-08-31T00:27:01.740734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:57:04.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740756+0000","last_change":"2023-08-31T00:27:00.327757+0000","last_active":"2023-08-31T00:27:01.740756+0000","last_peered":"2023-08-31T00:27:01.740756+0000","last_clean":"2023-08-31T00:27:01.740756+0000","last_became_active":"2023-08-31T00:27:00.327504+0000","last_became_peered":"2023-08-31T00:27:00.327504+0000","last_unstale":"2023-08-31T00:27:01.740756+0000","last_undegraded":"2023-08-31T00:27:01.740756+0000","last_fullsized":"2023-08-31T00:27:01.740756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:01:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740669+0000","last_change":"2023-08-31T00:27:00.319958+0000","last_active":"2023-08-31T00:27:01.740669+0000","last_peered":"2023-08-31T00:27:01.740669+0000","last_clean":"2023-08-31T00:27:01.740669+0000","last_became_active":"2023-08-31T00:27:00.319594+0000","last_became_peered":"2023-08-31T00:27:00.319594+0000","last_unstale":"2023-08-31T00:27:01.740669+0000","last_undegraded":"2023-08-31T00:27:01.740669+0000","last_fullsized":"2023-08-31T00:27:01.740669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:01:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740385+0000","last_change":"2023-08-31T00:27:00.327585+0000","last_active":"2023-08-31T00:27:01.740385+0000","last_peered":"2023-08-31T00:27:01.740385+0000","last_clean":"2023-08-31T00:27:01.740385+0000","last_became_active":"2023-08-31T00:27:00.324961+0000","last_became_peered":"2023-08-31T00:27:00.324961+0000","last_unstale":"2023-08-31T00:27:01.740385+0000","last_undegraded":"2023-08-31T00:27:01.740385+0000","last_fullsized":"2023-08-31T00:27:01.740385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741358+0000","last_change":"2023-08-31T00:27:00.325501+0000","last_active":"2023-08-31T00:27:01.741358+0000","last_peered":"2023-08-31T00:27:01.741358+0000","last_clean":"2023-08-31T00:27:01.741358+0000","last_became_active":"2023-08-31T00:27:00.325229+0000","last_became_peered":"2023-08-31T00:27:00.325229+0000","last_unstale":"2023-08-31T00:27:01.741358+0000","last_undegraded":"2023-08-31T00:27:01.741358+0000","last_fullsized":"2023-08-31T00:27:01.741358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:51.688515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.303071+0000","last_change":"2023-08-31T00:27:00.324789+0000","last_active":"2023-08-31T00:27:01.303071+0000","last_peered":"2023-08-31T00:27:01.303071+0000","last_clean":"2023-08-31T00:27:01.303071+0000","last_became_active":"2023-08-31T00:27:00.324505+0000","last_became_peered":"2023-08-31T00:27:00.324505+0000","last_unstale":"2023-08-31T00:27:01.303071+0000","last_undegraded":"2023-08-31T00:27:01.303071+0000","last_fullsized":"2023-08-31T00:27:01.303071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302274+0000","last_change":"2023-08-31T00:27:00.324716+0000","last_active":"2023-08-31T00:27:01.302274+0000","last_peered":"2023-08-31T00:27:01.302274+0000","last_clean":"2023-08-31T00:27:01.302274+0000","last_became_active":"2023-08-31T00:27:00.324443+0000","last_became_peered":"2023-08-31T00:27:00.324443+0000","last_unstale":"2023-08-31T00:27:01.302274+0000","last_undegraded":"2023-08-31T00:27:01.302274+0000","last_fullsized":"2023-08-31T00:27:01.302274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302552+0000","last_change":"2023-08-31T00:27:00.312173+0000","last_active":"2023-08-31T00:27:01.302552+0000","last_peered":"2023-08-31T00:27:01.302552+0000","last_clean":"2023-08-31T00:27:01.302552+0000","last_became_active":"2023-08-31T00:27:00.311885+0000","last_became_peered":"2023-08-31T00:27:00.311885+0000","last_unstale":"2023-08-31T00:27:01.302552+0000","last_undegraded":"2023-08-31T00:27:01.302552+0000","last_fullsized":"2023-08-31T00:27:01.302552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740589+0000","last_change":"2023-08-31T00:27:00.323165+0000","last_active":"2023-08-31T00:27:01.740589+0000","last_peered":"2023-08-31T00:27:01.740589+0000","last_clean":"2023-08-31T00:27:01.740589+0000","last_became_active":"2023-08-31T00:27:00.322854+0000","last_became_peered":"2023-08-31T00:27:00.322854+0000","last_unstale":"2023-08-31T00:27:01.740589+0000","last_undegraded":"2023-08-31T00:27:01.740589+0000","last_fullsized":"2023-08-31T00:27:01.740589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741248+0000","last_change":"2023-08-31T00:27:00.312986+0000","last_active":"2023-08-31T00:27:01.741248+0000","last_peered":"2023-08-31T00:27:01.741248+0000","last_clean":"2023-08-31T00:27:01.741248+0000","last_became_active":"2023-08-31T00:27:00.312500+0000","last_became_peered":"2023-08-31T00:27:00.312500+0000","last_unstale":"2023-08-31T00:27:01.741248+0000","last_undegraded":"2023-08-31T00:27:01.741248+0000","last_fullsized":"2023-08-31T00:27:01.741248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299787+0000","last_change":"2023-08-31T00:27:00.314835+0000","last_active":"2023-08-31T00:27:01.299787+0000","last_peered":"2023-08-31T00:27:01.299787+0000","last_clean":"2023-08-31T00:27:01.299787+0000","last_became_active":"2023-08-31T00:27:00.314578+0000","last_became_peered":"2023-08-31T00:27:00.314578+0000","last_unstale":"2023-08-31T00:27:01.299787+0000","last_undegraded":"2023-08-31T00:27:01.299787+0000","last_fullsized":"2023-08-31T00:27:01.299787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741046+0000","last_change":"2023-08-31T00:27:00.327680+0000","last_active":"2023-08-31T00:27:01.741046+0000","last_peered":"2023-08-31T00:27:01.741046+0000","last_clean":"2023-08-31T00:27:01.741046+0000","last_became_active":"2023-08-31T00:27:00.327418+0000","last_became_peered":"2023-08-31T00:27:00.327418+0000","last_unstale":"2023-08-31T00:27:01.741046+0000","last_undegraded":"2023-08-31T00:27:01.741046+0000","last_fullsized":"2023-08-31T00:27:01.741046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:57:04.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741479+0000","last_change":"2023-08-31T00:27:00.327254+0000","last_active":"2023-08-31T00:27:01.741479+0000","last_peered":"2023-08-31T00:27:01.741479+0000","last_clean":"2023-08-31T00:27:01.741479+0000","last_became_active":"2023-08-31T00:27:00.326713+0000","last_became_peered":"2023-08-31T00:27:00.326713+0000","last_unstale":"2023-08-31T00:27:01.741479+0000","last_undegraded":"2023-08-31T00:27:01.741479+0000","last_fullsized":"2023-08-31T00:27:01.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:51.688515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740625+0000","last_change":"2023-08-31T00:27:00.303375+0000","last_active":"2023-08-31T00:27:01.740625+0000","last_peered":"2023-08-31T00:27:01.740625+0000","last_clean":"2023-08-31T00:27:01.740625+0000","last_became_active":"2023-08-31T00:27:00.303086+0000","last_became_peered":"2023-08-31T00:27:00.303086+0000","last_unstale":"2023-08-31T00:27:01.740625+0000","last_undegraded":"2023-08-31T00:27:01.740625+0000","last_fullsized":"2023-08-31T00:27:01.740625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741433+0000","last_change":"2023-08-31T00:27:00.315115+0000","last_active":"2023-08-31T00:27:01.741433+0000","last_peered":"2023-08-31T00:27:01.741433+0000","last_clean":"2023-08-31T00:27:01.741433+0000","last_became_active":"2023-08-31T00:27:00.314835+0000","last_became_peered":"2023-08-31T00:27:00.314835+0000","last_unstale":"2023-08-31T00:27:01.741433+0000","last_undegraded":"2023-08-31T00:27:01.741433+0000","last_fullsized":"2023-08-31T00:27:01.741433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:05:57.152112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128207+0000","last_change":"2023-08-31T00:26:59.319947+0000","last_active":"2023-08-31T00:27:01.128207+0000","last_peered":"2023-08-31T00:27:01.128207+0000","last_clean":"2023-08-31T00:27:01.128207+0000","last_became_active":"2023-08-31T00:26:59.319620+0000","last_became_peered":"2023-08-31T00:26:59.319620+0000","last_unstale":"2023-08-31T00:27:01.128207+0000","last_undegraded":"2023-08-31T00:27:01.128207+0000","last_fullsized":"2023-08-31T00:27:01.128207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740780+0000","last_change":"2023-08-31T00:27:00.318524+0000","last_active":"2023-08-31T00:27:01.740780+0000","last_peered":"2023-08-31T00:27:01.740780+0000","last_clean":"2023-08-31T00:27:01.740780+0000","last_became_active":"2023-08-31T00:27:00.318265+0000","last_became_peered":"2023-08-31T00:27:00.318265+0000","last_unstale":"2023-08-31T00:27:01.740780+0000","last_undegraded":"2023-08-31T00:27:01.740780+0000","last_fullsized":"2023-08-31T00:27:01.740780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128305+0000","last_change":"2023-08-31T00:26:59.307239+0000","last_active":"2023-08-31T00:27:01.128305+0000","last_peered":"2023-08-31T00:27:01.128305+0000","last_clean":"2023-08-31T00:27:01.128305+0000","last_became_active":"2023-08-31T00:26:59.306693+0000","last_became_peered":"2023-08-31T00:26:59.306693+0000","last_unstale":"2023-08-31T00:27:01.128305+0000","last_undegraded":"2023-08-31T00:27:01.128305+0000","last_fullsized":"2023-08-31T00:27:01.128305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741087+0000","last_change":"2023-08-31T00:27:00.324786+0000","last_active":"2023-08-31T00:27:01.741087+0000","last_peered":"2023-08-31T00:27:01.741087+0000","last_clean":"2023-08-31T00:27:01.741087+0000","last_became_active":"2023-08-31T00:27:00.324524+0000","last_became_peered":"2023-08-31T00:27:00.324524+0000","last_unstale":"2023-08-31T00:27:01.741087+0000","last_undegraded":"2023-08-31T00:27:01.741087+0000","last_fullsized":"2023-08-31T00:27:01.741087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126879+0000","last_change":"2023-08-31T00:26:59.326328+0000","last_active":"2023-08-31T00:27:01.126879+0000","last_peered":"2023-08-31T00:27:01.126879+0000","last_clean":"2023-08-31T00:27:01.126879+0000","last_became_active":"2023-08-31T00:26:59.326028+0000","last_became_peered":"2023-08-31T00:26:59.326028+0000","last_unstale":"2023-08-31T00:27:01.126879+0000","last_undegraded":"2023-08-31T00:27:01.126879+0000","last_fullsized":"2023-08-31T00:27:01.126879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741079+0000","last_change":"2023-08-31T00:27:00.321637+0000","last_active":"2023-08-31T00:27:01.741079+0000","last_peered":"2023-08-31T00:27:01.741079+0000","last_clean":"2023-08-31T00:27:01.741079+0000","last_became_active":"2023-08-31T00:27:00.321377+0000","last_became_peered":"2023-08-31T00:27:00.321377+0000","last_unstale":"2023-08-31T00:27:01.741079+0000","last_undegraded":"2023-08-31T00:27:01.741079+0000","last_fullsized":"2023-08-31T00:27:01.741079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:09:48.611438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126810+0000","last_change":"2023-08-31T00:26:59.326471+0000","last_active":"2023-08-31T00:27:01.126810+0000","last_peered":"2023-08-31T00:27:01.126810+0000","last_clean":"2023-08-31T00:27:01.126810+0000","last_became_active":"2023-08-31T00:26:59.326163+0000","last_became_peered":"2023-08-31T00:26:59.326163+0000","last_unstale":"2023-08-31T00:27:01.126810+0000","last_undegraded":"2023-08-31T00:27:01.126810+0000","last_fullsized":"2023-08-31T00:27:01.126810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741431+0000","last_change":"2023-08-31T00:27:00.322301+0000","last_active":"2023-08-31T00:27:01.741431+0000","last_peered":"2023-08-31T00:27:01.741431+0000","last_clean":"2023-08-31T00:27:01.741431+0000","last_became_active":"2023-08-31T00:27:00.321299+0000","last_became_peered":"2023-08-31T00:27:00.321299+0000","last_unstale":"2023-08-31T00:27:01.741431+0000","last_undegraded":"2023-08-31T00:27:01.741431+0000","last_fullsized":"2023-08-31T00:27:01.741431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:40:38.763036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128268+0000","last_change":"2023-08-31T00:26:59.316902+0000","last_active":"2023-08-31T00:27:01.128268+0000","last_peered":"2023-08-31T00:27:01.128268+0000","last_clean":"2023-08-31T00:27:01.128268+0000","last_became_active":"2023-08-31T00:26:59.316643+0000","last_became_peered":"2023-08-31T00:26:59.316643+0000","last_unstale":"2023-08-31T00:27:01.128268+0000","last_undegraded":"2023-08-31T00:27:01.128268+0000","last_fullsized":"2023-08-31T00:27:01.128268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:42.963922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302177+0000","last_change":"2023-08-31T00:27:00.316602+0000","last_active":"2023-08-31T00:27:01.302177+0000","last_peered":"2023-08-31T00:27:01.302177+0000","last_clean":"2023-08-31T00:27:01.302177+0000","last_became_active":"2023-08-31T00:27:00.316285+0000","last_became_peered":"2023-08-31T00:27:00.316285+0000","last_unstale":"2023-08-31T00:27:01.302177+0000","last_undegraded":"2023-08-31T00:27:01.302177+0000","last_fullsized":"2023-08-31T00:27:01.302177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126465+0000","last_change":"2023-08-31T00:26:59.314263+0000","last_active":"2023-08-31T00:27:01.126465+0000","last_peered":"2023-08-31T00:27:01.126465+0000","last_clean":"2023-08-31T00:27:01.126465+0000","last_became_active":"2023-08-31T00:26:59.314015+0000","last_became_peered":"2023-08-31T00:26:59.314015+0000","last_unstale":"2023-08-31T00:27:01.126465+0000","last_undegraded":"2023-08-31T00:27:01.126465+0000","last_fullsized":"2023-08-31T00:27:01.126465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741442+0000","last_change":"2023-08-31T00:27:00.315878+0000","last_active":"2023-08-31T00:27:01.741442+0000","last_peered":"2023-08-31T00:27:01.741442+0000","last_clean":"2023-08-31T00:27:01.741442+0000","last_became_active":"2023-08-31T00:27:00.315491+0000","last_became_peered":"2023-08-31T00:27:00.315491+0000","last_unstale":"2023-08-31T00:27:01.741442+0000","last_undegraded":"2023-08-31T00:27:01.741442+0000","last_fullsized":"2023-08-31T00:27:01.741442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128184+0000","last_change":"2023-08-31T00:26:59.313625+0000","last_active":"2023-08-31T00:27:01.128184+0000","last_peered":"2023-08-31T00:27:01.128184+0000","last_clean":"2023-08-31T00:27:01.128184+0000","last_became_active":"2023-08-31T00:26:59.313352+0000","last_became_peered":"2023-08-31T00:26:59.313352+0000","last_unstale":"2023-08-31T00:27:01.128184+0000","last_undegraded":"2023-08-31T00:27:01.128184+0000","last_fullsized":"2023-08-31T00:27:01.128184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740986+0000","last_change":"2023-08-31T00:27:00.328716+0000","last_active":"2023-08-31T00:27:01.740986+0000","last_peered":"2023-08-31T00:27:01.740986+0000","last_clean":"2023-08-31T00:27:01.740986+0000","last_became_active":"2023-08-31T00:27:00.328462+0000","last_became_peered":"2023-08-31T00:27:00.328462+0000","last_unstale":"2023-08-31T00:27:01.740986+0000","last_undegraded":"2023-08-31T00:27:01.740986+0000","last_fullsized":"2023-08-31T00:27:01.740986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:09:48.611438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133575+0000","last_change":"2023-08-31T00:26:59.318075+0000","last_active":"2023-08-31T00:27:01.133575+0000","last_peered":"2023-08-31T00:27:01.133575+0000","last_clean":"2023-08-31T00:27:01.133575+0000","last_became_active":"2023-08-31T00:26:59.314966+0000","last_became_peered":"2023-08-31T00:26:59.314966+0000","last_unstale":"2023-08-31T00:27:01.133575+0000","last_undegraded":"2023-08-31T00:27:01.133575+0000","last_fullsized":"2023-08-31T00:27:01.133575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299954+0000","last_change":"2023-08-31T00:27:00.322612+0000","last_active":"2023-08-31T00:27:01.299954+0000","last_peered":"2023-08-31T00:27:01.299954+0000","last_clean":"2023-08-31T00:27:01.299954+0000","last_became_active":"2023-08-31T00:27:00.322332+0000","last_became_peered":"2023-08-31T00:27:00.322332+0000","last_unstale":"2023-08-31T00:27:01.299954+0000","last_undegraded":"2023-08-31T00:27:01.299954+0000","last_fullsized":"2023-08-31T00:27:01.299954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126573+0000","last_change":"2023-08-31T00:26:59.317148+0000","last_active":"2023-08-31T00:27:01.126573+0000","last_peered":"2023-08-31T00:27:01.126573+0000","last_clean":"2023-08-31T00:27:01.126573+0000","last_became_active":"2023-08-31T00:26:59.316679+0000","last_became_peered":"2023-08-31T00:26:59.316679+0000","last_unstale":"2023-08-31T00:27:01.126573+0000","last_undegraded":"2023-08-31T00:27:01.126573+0000","last_fullsized":"2023-08-31T00:27:01.126573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741575+0000","last_change":"2023-08-31T00:27:00.327124+0000","last_active":"2023-08-31T00:27:01.741575+0000","last_peered":"2023-08-31T00:27:01.741575+0000","last_clean":"2023-08-31T00:27:01.741575+0000","last_became_active":"2023-08-31T00:27:00.326440+0000","last_became_peered":"2023-08-31T00:27:00.326440+0000","last_unstale":"2023-08-31T00:27:01.741575+0000","last_undegraded":"2023-08-31T00:27:01.741575+0000","last_fullsized":"2023-08-31T00:27:01.741575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:26:26.978175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133765+0000","last_change":"2023-08-31T00:26:59.319209+0000","last_active":"2023-08-31T00:27:01.133765+0000","last_peered":"2023-08-31T00:27:01.133765+0000","last_clean":"2023-08-31T00:27:01.133765+0000","last_became_active":"2023-08-31T00:26:59.318940+0000","last_became_peered":"2023-08-31T00:26:59.318940+0000","last_unstale":"2023-08-31T00:27:01.133765+0000","last_undegraded":"2023-08-31T00:27:01.133765+0000","last_fullsized":"2023-08-31T00:27:01.133765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:14.443886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741437+0000","last_change":"2023-08-31T00:27:00.321858+0000","last_active":"2023-08-31T00:27:01.741437+0000","last_peered":"2023-08-31T00:27:01.741437+0000","last_clean":"2023-08-31T00:27:01.741437+0000","last_became_active":"2023-08-31T00:27:00.321595+0000","last_became_peered":"2023-08-31T00:27:00.321595+0000","last_unstale":"2023-08-31T00:27:01.741437+0000","last_undegraded":"2023-08-31T00:27:01.741437+0000","last_fullsized":"2023-08-31T00:27:01.741437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132325+0000","last_change":"2023-08-31T00:26:59.317069+0000","last_active":"2023-08-31T00:27:01.132325+0000","last_peered":"2023-08-31T00:27:01.132325+0000","last_clean":"2023-08-31T00:27:01.132325+0000","last_became_active":"2023-08-31T00:26:59.316783+0000","last_became_peered":"2023-08-31T00:26:59.316783+0000","last_unstale":"2023-08-31T00:27:01.132325+0000","last_undegraded":"2023-08-31T00:27:01.132325+0000","last_fullsized":"2023-08-31T00:27:01.132325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:12.495239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302548+0000","last_change":"2023-08-31T00:27:00.317789+0000","last_active":"2023-08-31T00:27:01.302548+0000","last_peered":"2023-08-31T00:27:01.302548+0000","last_clean":"2023-08-31T00:27:01.302548+0000","last_became_active":"2023-08-31T00:27:00.317275+0000","last_became_peered":"2023-08-31T00:27:00.317275+0000","last_unstale":"2023-08-31T00:27:01.302548+0000","last_undegraded":"2023-08-31T00:27:01.302548+0000","last_fullsized":"2023-08-31T00:27:01.302548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126490+0000","last_change":"2023-08-31T00:26:59.310802+0000","last_active":"2023-08-31T00:27:01.126490+0000","last_peered":"2023-08-31T00:27:01.126490+0000","last_clean":"2023-08-31T00:27:01.126490+0000","last_became_active":"2023-08-31T00:26:59.310150+0000","last_became_peered":"2023-08-31T00:26:59.310150+0000","last_unstale":"2023-08-31T00:27:01.126490+0000","last_undegraded":"2023-08-31T00:27:01.126490+0000","last_fullsized":"2023-08-31T00:27:01.126490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741481+0000","last_change":"2023-08-31T00:27:00.324514+0000","last_active":"2023-08-31T00:27:01.741481+0000","last_peered":"2023-08-31T00:27:01.741481+0000","last_clean":"2023-08-31T00:27:01.741481+0000","last_became_active":"2023-08-31T00:27:00.324137+0000","last_became_peered":"2023-08-31T00:27:00.324137+0000","last_unstale":"2023-08-31T00:27:01.741481+0000","last_undegraded":"2023-08-31T00:27:01.741481+0000","last_fullsized":"2023-08-31T00:27:01.741481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:26:26.978175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128145+0000","last_change":"2023-08-31T00:26:59.308265+0000","last_active":"2023-08-31T00:27:01.128145+0000","last_peered":"2023-08-31T00:27:01.128145+0000","last_clean":"2023-08-31T00:27:01.128145+0000","last_became_active":"2023-08-31T00:26:59.307956+0000","last_became_peered":"2023-08-31T00:26:59.307956+0000","last_unstale":"2023-08-31T00:27:01.128145+0000","last_undegraded":"2023-08-31T00:27:01.128145+0000","last_fullsized":"2023-08-31T00:27:01.128145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741109+0000","last_change":"2023-08-31T00:27:00.314782+0000","last_active":"2023-08-31T00:27:01.741109+0000","last_peered":"2023-08-31T00:27:01.741109+0000","last_clean":"2023-08-31T00:27:01.741109+0000","last_became_active":"2023-08-31T00:27:00.314505+0000","last_became_peered":"2023-08-31T00:27:00.314505+0000","last_unstale":"2023-08-31T00:27:01.741109+0000","last_undegraded":"2023-08-31T00:27:01.741109+0000","last_fullsized":"2023-08-31T00:27:01.741109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133668+0000","last_change":"2023-08-31T00:26:59.320415+0000","last_active":"2023-08-31T00:27:01.133668+0000","last_peered":"2023-08-31T00:27:01.133668+0000","last_clean":"2023-08-31T00:27:01.133668+0000","last_became_active":"2023-08-31T00:26:59.319939+0000","last_became_peered":"2023-08-31T00:26:59.319939+0000","last_unstale":"2023-08-31T00:27:01.133668+0000","last_undegraded":"2023-08-31T00:27:01.133668+0000","last_fullsized":"2023-08-31T00:27:01.133668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:08.276952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741714+0000","last_change":"2023-08-31T00:27:00.316185+0000","last_active":"2023-08-31T00:27:01.741714+0000","last_peered":"2023-08-31T00:27:01.741714+0000","last_clean":"2023-08-31T00:27:01.741714+0000","last_became_active":"2023-08-31T00:27:00.315707+0000","last_became_peered":"2023-08-31T00:27:00.315707+0000","last_unstale":"2023-08-31T00:27:01.741714+0000","last_undegraded":"2023-08-31T00:27:01.741714+0000","last_fullsized":"2023-08-31T00:27:01.741714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:47:01.340345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126442+0000","last_change":"2023-08-31T00:26:59.313185+0000","last_active":"2023-08-31T00:27:01.126442+0000","last_peered":"2023-08-31T00:27:01.126442+0000","last_clean":"2023-08-31T00:27:01.126442+0000","last_became_active":"2023-08-31T00:26:59.312883+0000","last_became_peered":"2023-08-31T00:26:59.312883+0000","last_unstale":"2023-08-31T00:27:01.126442+0000","last_undegraded":"2023-08-31T00:27:01.126442+0000","last_fullsized":"2023-08-31T00:27:01.126442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301538+0000","last_change":"2023-08-31T00:27:00.307379+0000","last_active":"2023-08-31T00:27:01.301538+0000","last_peered":"2023-08-31T00:27:01.301538+0000","last_clean":"2023-08-31T00:27:01.301538+0000","last_became_active":"2023-08-31T00:27:00.307055+0000","last_became_peered":"2023-08-31T00:27:00.307055+0000","last_unstale":"2023-08-31T00:27:01.301538+0000","last_undegraded":"2023-08-31T00:27:01.301538+0000","last_fullsized":"2023-08-31T00:27:01.301538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134418+0000","last_change":"2023-08-31T00:26:59.312847+0000","last_active":"2023-08-31T00:27:01.134418+0000","last_peered":"2023-08-31T00:27:01.134418+0000","last_clean":"2023-08-31T00:27:01.134418+0000","last_became_active":"2023-08-31T00:26:59.312546+0000","last_became_peered":"2023-08-31T00:26:59.312546+0000","last_unstale":"2023-08-31T00:27:01.134418+0000","last_undegraded":"2023-08-31T00:27:01.134418+0000","last_fullsized":"2023-08-31T00:27:01.134418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740920+0000","last_change":"2023-08-31T00:27:00.314713+0000","last_active":"2023-08-31T00:27:01.740920+0000","last_peered":"2023-08-31T00:27:01.740920+0000","last_clean":"2023-08-31T00:27:01.740920+0000","last_became_active":"2023-08-31T00:27:00.314421+0000","last_became_peered":"2023-08-31T00:27:00.314421+0000","last_unstale":"2023-08-31T00:27:01.740920+0000","last_undegraded":"2023-08-31T00:27:01.740920+0000","last_fullsized":"2023-08-31T00:27:01.740920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:09:48.611438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132990+0000","last_change":"2023-08-31T00:26:59.315973+0000","last_active":"2023-08-31T00:27:01.132990+0000","last_peered":"2023-08-31T00:27:01.132990+0000","last_clean":"2023-08-31T00:27:01.132990+0000","last_became_active":"2023-08-31T00:26:59.315513+0000","last_became_peered":"2023-08-31T00:26:59.315513+0000","last_unstale":"2023-08-31T00:27:01.132990+0000","last_undegraded":"2023-08-31T00:27:01.132990+0000","last_fullsized":"2023-08-31T00:27:01.132990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740953+0000","last_change":"2023-08-31T00:27:00.314705+0000","last_active":"2023-08-31T00:27:01.740953+0000","last_peered":"2023-08-31T00:27:01.740953+0000","last_clean":"2023-08-31T00:27:01.740953+0000","last_became_active":"2023-08-31T00:27:00.314428+0000","last_became_peered":"2023-08-31T00:27:00.314428+0000","last_unstale":"2023-08-31T00:27:01.740953+0000","last_undegraded":"2023-08-31T00:27:01.740953+0000","last_fullsized":"2023-08-31T00:27:01.740953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:02:32.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132289+0000","last_change":"2023-08-31T00:26:59.311823+0000","last_active":"2023-08-31T00:27:01.132289+0000","last_peered":"2023-08-31T00:27:01.132289+0000","last_clean":"2023-08-31T00:27:01.132289+0000","last_became_active":"2023-08-31T00:26:59.311483+0000","last_became_peered":"2023-08-31T00:26:59.311483+0000","last_unstale":"2023-08-31T00:27:01.132289+0000","last_undegraded":"2023-08-31T00:27:01.132289+0000","last_fullsized":"2023-08-31T00:27:01.132289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741582+0000","last_change":"2023-08-31T00:27:00.325548+0000","last_active":"2023-08-31T00:27:01.741582+0000","last_peered":"2023-08-31T00:27:01.741582+0000","last_clean":"2023-08-31T00:27:01.741582+0000","last_became_active":"2023-08-31T00:27:00.325055+0000","last_became_peered":"2023-08-31T00:27:00.325055+0000","last_unstale":"2023-08-31T00:27:01.741582+0000","last_undegraded":"2023-08-31T00:27:01.741582+0000","last_fullsized":"2023-08-31T00:27:01.741582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:05:57.152112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133654+0000","last_change":"2023-08-31T00:26:59.318639+0000","last_active":"2023-08-31T00:27:01.133654+0000","last_peered":"2023-08-31T00:27:01.133654+0000","last_clean":"2023-08-31T00:27:01.133654+0000","last_became_active":"2023-08-31T00:26:59.318291+0000","last_became_peered":"2023-08-31T00:26:59.318291+0000","last_unstale":"2023-08-31T00:27:01.133654+0000","last_undegraded":"2023-08-31T00:27:01.133654+0000","last_fullsized":"2023-08-31T00:27:01.133654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301621+0000","last_change":"2023-08-31T00:27:00.328847+0000","last_active":"2023-08-31T00:27:01.301621+0000","last_peered":"2023-08-31T00:27:01.301621+0000","last_clean":"2023-08-31T00:27:01.301621+0000","last_became_active":"2023-08-31T00:27:00.328588+0000","last_became_peered":"2023-08-31T00:27:00.328588+0000","last_unstale":"2023-08-31T00:27:01.301621+0000","last_undegraded":"2023-08-31T00:27:01.301621+0000","last_fullsized":"2023-08-31T00:27:01.301621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299745+0000","last_change":"2023-08-31T00:27:00.319649+0000","last_active":"2023-08-31T00:27:01.299745+0000","last_peered":"2023-08-31T00:27:01.299745+0000","last_clean":"2023-08-31T00:27:01.299745+0000","last_became_active":"2023-08-31T00:27:00.319365+0000","last_became_peered":"2023-08-31T00:27:00.319365+0000","last_unstale":"2023-08-31T00:27:01.299745+0000","last_undegraded":"2023-08-31T00:27:01.299745+0000","last_fullsized":"2023-08-31T00:27:01.299745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134434+0000","last_change":"2023-08-31T00:26:59.314564+0000","last_active":"2023-08-31T00:27:01.134434+0000","last_peered":"2023-08-31T00:27:01.134434+0000","last_clean":"2023-08-31T00:27:01.134434+0000","last_became_active":"2023-08-31T00:26:59.314296+0000","last_became_peered":"2023-08-31T00:26:59.314296+0000","last_unstale":"2023-08-31T00:27:01.134434+0000","last_undegraded":"2023-08-31T00:27:01.134434+0000","last_fullsized":"2023-08-31T00:27:01.134434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:06.610718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740631+0000","last_change":"2023-08-31T00:27:00.329442+0000","last_active":"2023-08-31T00:27:01.740631+0000","last_peered":"2023-08-31T00:27:01.740631+0000","last_clean":"2023-08-31T00:27:01.740631+0000","last_became_active":"2023-08-31T00:27:00.329237+0000","last_became_peered":"2023-08-31T00:27:00.329237+0000","last_unstale":"2023-08-31T00:27:01.740631+0000","last_undegraded":"2023-08-31T00:27:01.740631+0000","last_fullsized":"2023-08-31T00:27:01.740631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:35.008667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133681+0000","last_change":"2023-08-31T00:26:59.314864+0000","last_active":"2023-08-31T00:27:01.133681+0000","last_peered":"2023-08-31T00:27:01.133681+0000","last_clean":"2023-08-31T00:27:01.133681+0000","last_became_active":"2023-08-31T00:26:59.313879+0000","last_became_peered":"2023-08-31T00:26:59.313879+0000","last_unstale":"2023-08-31T00:27:01.133681+0000","last_undegraded":"2023-08-31T00:27:01.133681+0000","last_fullsized":"2023-08-31T00:27:01.133681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:53.782002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.304738+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:27:00.304738+0000","last_peered":"2023-08-31T00:27:00.304738+0000","last_clean":"2023-08-31T00:27:00.304738+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:27:00.304738+0000","last_undegraded":"2023-08-31T00:27:00.304738+0000","last_fullsized":"2023-08-31T00:27:00.304738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740268+0000","last_change":"2023-08-31T00:27:00.315831+0000","last_active":"2023-08-31T00:27:01.740268+0000","last_peered":"2023-08-31T00:27:01.740268+0000","last_clean":"2023-08-31T00:27:01.740268+0000","last_became_active":"2023-08-31T00:27:00.315547+0000","last_became_peered":"2023-08-31T00:27:00.315547+0000","last_unstale":"2023-08-31T00:27:01.740268+0000","last_undegraded":"2023-08-31T00:27:01.740268+0000","last_fullsized":"2023-08-31T00:27:01.740268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126723+0000","last_change":"2023-08-31T00:26:59.323394+0000","last_active":"2023-08-31T00:27:01.126723+0000","last_peered":"2023-08-31T00:27:01.126723+0000","last_clean":"2023-08-31T00:27:01.126723+0000","last_became_active":"2023-08-31T00:26:59.323150+0000","last_became_peered":"2023-08-31T00:26:59.323150+0000","last_unstale":"2023-08-31T00:27:01.126723+0000","last_undegraded":"2023-08-31T00:27:01.126723+0000","last_fullsized":"2023-08-31T00:27:01.126723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126865+0000","last_change":"2023-08-31T00:26:59.323065+0000","last_active":"2023-08-31T00:27:01.126865+0000","last_peered":"2023-08-31T00:27:01.126865+0000","last_clean":"2023-08-31T00:27:01.126865+0000","last_became_active":"2023-08-31T00:26:59.322673+0000","last_became_peered":"2023-08-31T00:26:59.322673+0000","last_unstale":"2023-08-31T00:27:01.126865+0000","last_undegraded":"2023-08-31T00:27:01.126865+0000","last_fullsized":"2023-08-31T00:27:01.126865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299875+0000","last_change":"2023-08-31T00:27:00.319918+0000","last_active":"2023-08-31T00:27:01.299875+0000","last_peered":"2023-08-31T00:27:01.299875+0000","last_clean":"2023-08-31T00:27:01.299875+0000","last_became_active":"2023-08-31T00:27:00.319656+0000","last_became_peered":"2023-08-31T00:27:00.319656+0000","last_unstale":"2023-08-31T00:27:01.299875+0000","last_undegraded":"2023-08-31T00:27:01.299875+0000","last_fullsized":"2023-08-31T00:27:01.299875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.300007+0000","last_change":"2023-08-31T00:26:59.316728+0000","last_active":"2023-08-31T00:27:01.300007+0000","last_peered":"2023-08-31T00:27:01.300007+0000","last_clean":"2023-08-31T00:27:01.300007+0000","last_became_active":"2023-08-31T00:26:59.316325+0000","last_became_peered":"2023-08-31T00:26:59.316325+0000","last_unstale":"2023-08-31T00:27:01.300007+0000","last_undegraded":"2023-08-31T00:27:01.300007+0000","last_fullsized":"2023-08-31T00:27:01.300007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741118+0000","last_change":"2023-08-31T00:27:00.317323+0000","last_active":"2023-08-31T00:27:01.741118+0000","last_peered":"2023-08-31T00:27:01.741118+0000","last_clean":"2023-08-31T00:27:01.741118+0000","last_became_active":"2023-08-31T00:27:00.317051+0000","last_became_peered":"2023-08-31T00:27:00.317051+0000","last_unstale":"2023-08-31T00:27:01.741118+0000","last_undegraded":"2023-08-31T00:27:01.741118+0000","last_fullsized":"2023-08-31T00:27:01.741118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:14:43.010670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126559+0000","last_change":"2023-08-31T00:26:59.319291+0000","last_active":"2023-08-31T00:27:01.126559+0000","last_peered":"2023-08-31T00:27:01.126559+0000","last_clean":"2023-08-31T00:27:01.126559+0000","last_became_active":"2023-08-31T00:26:59.318911+0000","last_became_peered":"2023-08-31T00:26:59.318911+0000","last_unstale":"2023-08-31T00:27:01.126559+0000","last_undegraded":"2023-08-31T00:27:01.126559+0000","last_fullsized":"2023-08-31T00:27:01.126559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741325+0000","last_change":"2023-08-31T00:27:00.315232+0000","last_active":"2023-08-31T00:27:01.741325+0000","last_peered":"2023-08-31T00:27:01.741325+0000","last_clean":"2023-08-31T00:27:01.741325+0000","last_became_active":"2023-08-31T00:27:00.314924+0000","last_became_peered":"2023-08-31T00:27:00.314924+0000","last_unstale":"2023-08-31T00:27:01.741325+0000","last_undegraded":"2023-08-31T00:27:01.741325+0000","last_fullsized":"2023-08-31T00:27:01.741325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:35.008667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126669+0000","last_change":"2023-08-31T00:26:59.322925+0000","last_active":"2023-08-31T00:27:01.126669+0000","last_peered":"2023-08-31T00:27:01.126669+0000","last_clean":"2023-08-31T00:27:01.126669+0000","last_became_active":"2023-08-31T00:26:59.322585+0000","last_became_peered":"2023-08-31T00:26:59.322585+0000","last_unstale":"2023-08-31T00:27:01.126669+0000","last_undegraded":"2023-08-31T00:27:01.126669+0000","last_fullsized":"2023-08-31T00:27:01.126669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301815+0000","last_change":"2023-08-31T00:27:00.312503+0000","last_active":"2023-08-31T00:27:01.301815+0000","last_peered":"2023-08-31T00:27:01.301815+0000","last_clean":"2023-08-31T00:27:01.301815+0000","last_became_active":"2023-08-31T00:27:00.312047+0000","last_became_peered":"2023-08-31T00:27:00.312047+0000","last_unstale":"2023-08-31T00:27:01.301815+0000","last_undegraded":"2023-08-31T00:27:01.301815+0000","last_fullsized":"2023-08-31T00:27:01.301815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132250+0000","last_change":"2023-08-31T00:26:59.317022+0000","last_active":"2023-08-31T00:27:01.132250+0000","last_peered":"2023-08-31T00:27:01.132250+0000","last_clean":"2023-08-31T00:27:01.132250+0000","last_became_active":"2023-08-31T00:26:59.316703+0000","last_became_peered":"2023-08-31T00:26:59.316703+0000","last_unstale":"2023-08-31T00:27:01.132250+0000","last_undegraded":"2023-08-31T00:27:01.132250+0000","last_fullsized":"2023-08-31T00:27:01.132250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740454+0000","last_change":"2023-08-31T00:27:00.317829+0000","last_active":"2023-08-31T00:27:01.740454+0000","last_peered":"2023-08-31T00:27:01.740454+0000","last_clean":"2023-08-31T00:27:01.740454+0000","last_became_active":"2023-08-31T00:27:00.317552+0000","last_became_peered":"2023-08-31T00:27:00.317552+0000","last_unstale":"2023-08-31T00:27:01.740454+0000","last_undegraded":"2023-08-31T00:27:01.740454+0000","last_fullsized":"2023-08-31T00:27:01.740454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132269+0000","last_change":"2023-08-31T00:26:59.310991+0000","last_active":"2023-08-31T00:27:01.132269+0000","last_peered":"2023-08-31T00:27:01.132269+0000","last_clean":"2023-08-31T00:27:01.132269+0000","last_became_active":"2023-08-31T00:26:59.310696+0000","last_became_peered":"2023-08-31T00:26:59.310696+0000","last_unstale":"2023-08-31T00:27:01.132269+0000","last_undegraded":"2023-08-31T00:27:01.132269+0000","last_fullsized":"2023-08-31T00:27:01.132269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740886+0000","last_change":"2023-08-31T00:27:00.329128+0000","last_active":"2023-08-31T00:27:01.740886+0000","last_peered":"2023-08-31T00:27:01.740886+0000","last_clean":"2023-08-31T00:27:01.740886+0000","last_became_active":"2023-08-31T00:27:00.328627+0000","last_became_peered":"2023-08-31T00:27:00.328627+0000","last_unstale":"2023-08-31T00:27:01.740886+0000","last_undegraded":"2023-08-31T00:27:01.740886+0000","last_fullsized":"2023-08-31T00:27:01.740886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:57:04.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126795+0000","last_change":"2023-08-31T00:26:59.325883+0000","last_active":"2023-08-31T00:27:01.126795+0000","last_peered":"2023-08-31T00:27:01.126795+0000","last_clean":"2023-08-31T00:27:01.126795+0000","last_became_active":"2023-08-31T00:26:59.325639+0000","last_became_peered":"2023-08-31T00:26:59.325639+0000","last_unstale":"2023-08-31T00:27:01.126795+0000","last_undegraded":"2023-08-31T00:27:01.126795+0000","last_fullsized":"2023-08-31T00:27:01.126795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:33.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301766+0000","last_change":"2023-08-31T00:27:00.312122+0000","last_active":"2023-08-31T00:27:01.301766+0000","last_peered":"2023-08-31T00:27:01.301766+0000","last_clean":"2023-08-31T00:27:01.301766+0000","last_became_active":"2023-08-31T00:27:00.311829+0000","last_became_peered":"2023-08-31T00:27:00.311829+0000","last_unstale":"2023-08-31T00:27:01.301766+0000","last_undegraded":"2023-08-31T00:27:01.301766+0000","last_fullsized":"2023-08-31T00:27:01.301766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:41.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134459+0000","last_change":"2023-08-31T00:26:59.321055+0000","last_active":"2023-08-31T00:27:01.134459+0000","last_peered":"2023-08-31T00:27:01.134459+0000","last_clean":"2023-08-31T00:27:01.134459+0000","last_became_active":"2023-08-31T00:26:59.320790+0000","last_became_peered":"2023-08-31T00:26:59.320790+0000","last_unstale":"2023-08-31T00:27:01.134459+0000","last_undegraded":"2023-08-31T00:27:01.134459+0000","last_fullsized":"2023-08-31T00:27:01.134459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741535+0000","last_change":"2023-08-31T00:27:00.325496+0000","last_active":"2023-08-31T00:27:01.741535+0000","last_peered":"2023-08-31T00:27:01.741535+0000","last_clean":"2023-08-31T00:27:01.741535+0000","last_became_active":"2023-08-31T00:27:00.325207+0000","last_became_peered":"2023-08-31T00:27:00.325207+0000","last_unstale":"2023-08-31T00:27:01.741535+0000","last_undegraded":"2023-08-31T00:27:01.741535+0000","last_fullsized":"2023-08-31T00:27:01.741535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:23.480298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132314+0000","last_change":"2023-08-31T00:26:59.311899+0000","last_active":"2023-08-31T00:27:01.132314+0000","last_peered":"2023-08-31T00:27:01.132314+0000","last_clean":"2023-08-31T00:27:01.132314+0000","last_became_active":"2023-08-31T00:26:59.311612+0000","last_became_peered":"2023-08-31T00:26:59.311612+0000","last_unstale":"2023-08-31T00:27:01.132314+0000","last_undegraded":"2023-08-31T00:27:01.132314+0000","last_fullsized":"2023-08-31T00:27:01.132314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741184+0000","last_change":"2023-08-31T00:27:00.334889+0000","last_active":"2023-08-31T00:27:01.741184+0000","last_peered":"2023-08-31T00:27:01.741184+0000","last_clean":"2023-08-31T00:27:01.741184+0000","last_became_active":"2023-08-31T00:27:00.334672+0000","last_became_peered":"2023-08-31T00:27:00.334672+0000","last_unstale":"2023-08-31T00:27:01.741184+0000","last_undegraded":"2023-08-31T00:27:01.741184+0000","last_fullsized":"2023-08-31T00:27:01.741184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:14:43.010670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134477+0000","last_change":"2023-08-31T00:26:59.311633+0000","last_active":"2023-08-31T00:27:01.134477+0000","last_peered":"2023-08-31T00:27:01.134477+0000","last_clean":"2023-08-31T00:27:01.134477+0000","last_became_active":"2023-08-31T00:26:59.311354+0000","last_became_peered":"2023-08-31T00:26:59.311354+0000","last_unstale":"2023-08-31T00:27:01.134477+0000","last_undegraded":"2023-08-31T00:27:01.134477+0000","last_fullsized":"2023-08-31T00:27:01.134477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740954+0000","last_change":"2023-08-31T00:27:00.318313+0000","last_active":"2023-08-31T00:27:01.740954+0000","last_peered":"2023-08-31T00:27:01.740954+0000","last_clean":"2023-08-31T00:27:01.740954+0000","last_became_active":"2023-08-31T00:27:00.318100+0000","last_became_peered":"2023-08-31T00:27:00.318100+0000","last_unstale":"2023-08-31T00:27:01.740954+0000","last_undegraded":"2023-08-31T00:27:01.740954+0000","last_fullsized":"2023-08-31T00:27:01.740954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:14:43.010670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301382+0000","last_change":"2023-08-31T00:27:00.307564+0000","last_active":"2023-08-31T00:27:01.301382+0000","last_peered":"2023-08-31T00:27:01.301382+0000","last_clean":"2023-08-31T00:27:01.301382+0000","last_became_active":"2023-08-31T00:27:00.307264+0000","last_became_peered":"2023-08-31T00:27:00.307264+0000","last_unstale":"2023-08-31T00:27:01.301382+0000","last_undegraded":"2023-08-31T00:27:01.301382+0000","last_fullsized":"2023-08-31T00:27:01.301382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740103+0000","last_change":"2023-08-31T00:27:00.322552+0000","last_active":"2023-08-31T00:27:01.740103+0000","last_peered":"2023-08-31T00:27:01.740103+0000","last_clean":"2023-08-31T00:27:01.740103+0000","last_became_active":"2023-08-31T00:27:00.322254+0000","last_became_peered":"2023-08-31T00:27:00.322254+0000","last_unstale":"2023-08-31T00:27:01.740103+0000","last_undegraded":"2023-08-31T00:27:01.740103+0000","last_fullsized":"2023-08-31T00:27:01.740103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741661+0000","last_change":"2023-08-31T00:27:00.334929+0000","last_active":"2023-08-31T00:27:01.741661+0000","last_peered":"2023-08-31T00:27:01.741661+0000","last_clean":"2023-08-31T00:27:01.741661+0000","last_became_active":"2023-08-31T00:27:00.334671+0000","last_became_peered":"2023-08-31T00:27:00.334671+0000","last_unstale":"2023-08-31T00:27:01.741661+0000","last_undegraded":"2023-08-31T00:27:01.741661+0000","last_fullsized":"2023-08-31T00:27:01.741661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:23.480298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741215+0000","last_change":"2023-08-31T00:27:00.327878+0000","last_active":"2023-08-31T00:27:01.741215+0000","last_peered":"2023-08-31T00:27:01.741215+0000","last_clean":"2023-08-31T00:27:01.741215+0000","last_became_active":"2023-08-31T00:27:00.327570+0000","last_became_peered":"2023-08-31T00:27:00.327570+0000","last_unstale":"2023-08-31T00:27:01.741215+0000","last_undegraded":"2023-08-31T00:27:01.741215+0000","last_fullsized":"2023-08-31T00:27:01.741215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740692+0000","last_change":"2023-08-31T00:27:00.321837+0000","last_active":"2023-08-31T00:27:01.740692+0000","last_peered":"2023-08-31T00:27:01.740692+0000","last_clean":"2023-08-31T00:27:01.740692+0000","last_became_active":"2023-08-31T00:27:00.321561+0000","last_became_peered":"2023-08-31T00:27:00.321561+0000","last_unstale":"2023-08-31T00:27:01.740692+0000","last_undegraded":"2023-08-31T00:27:01.740692+0000","last_fullsized":"2023-08-31T00:27:01.740692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299955+0000","last_change":"2023-08-31T00:27:00.322796+0000","last_active":"2023-08-31T00:27:01.299955+0000","last_peered":"2023-08-31T00:27:01.299955+0000","last_clean":"2023-08-31T00:27:01.299955+0000","last_became_active":"2023-08-31T00:27:00.322507+0000","last_became_peered":"2023-08-31T00:27:00.322507+0000","last_unstale":"2023-08-31T00:27:01.299955+0000","last_undegraded":"2023-08-31T00:27:01.299955+0000","last_fullsized":"2023-08-31T00:27:01.299955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:35.008667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302863+0000","last_change":"2023-08-31T00:27:00.311231+0000","last_active":"2023-08-31T00:27:01.302863+0000","last_peered":"2023-08-31T00:27:01.302863+0000","last_clean":"2023-08-31T00:27:01.302863+0000","last_became_active":"2023-08-31T00:27:00.310948+0000","last_became_peered":"2023-08-31T00:27:00.310948+0000","last_unstale":"2023-08-31T00:27:01.302863+0000","last_undegraded":"2023-08-31T00:27:01.302863+0000","last_fullsized":"2023-08-31T00:27:01.302863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740870+0000","last_change":"2023-08-31T00:27:00.321793+0000","last_active":"2023-08-31T00:27:01.740870+0000","last_peered":"2023-08-31T00:27:01.740870+0000","last_clean":"2023-08-31T00:27:01.740870+0000","last_became_active":"2023-08-31T00:27:00.321498+0000","last_became_peered":"2023-08-31T00:27:00.321498+0000","last_unstale":"2023-08-31T00:27:01.740870+0000","last_undegraded":"2023-08-31T00:27:01.740870+0000","last_fullsized":"2023-08-31T00:27:01.740870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:01:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740530+0000","last_change":"2023-08-31T00:27:00.327048+0000","last_active":"2023-08-31T00:27:01.740530+0000","last_peered":"2023-08-31T00:27:01.740530+0000","last_clean":"2023-08-31T00:27:01.740530+0000","last_became_active":"2023-08-31T00:27:00.326522+0000","last_became_peered":"2023-08-31T00:27:00.326522+0000","last_unstale":"2023-08-31T00:27:01.740530+0000","last_undegraded":"2023-08-31T00:27:01.740530+0000","last_fullsized":"2023-08-31T00:27:01.740530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740619+0000","last_change":"2023-08-31T00:27:00.322224+0000","last_active":"2023-08-31T00:27:01.740619+0000","last_peered":"2023-08-31T00:27:01.740619+0000","last_clean":"2023-08-31T00:27:01.740619+0000","last_became_active":"2023-08-31T00:27:00.321978+0000","last_became_peered":"2023-08-31T00:27:00.321978+0000","last_unstale":"2023-08-31T00:27:01.740619+0000","last_undegraded":"2023-08-31T00:27:01.740619+0000","last_fullsized":"2023-08-31T00:27:01.740619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740492+0000","last_change":"2023-08-31T00:27:00.327229+0000","last_active":"2023-08-31T00:27:01.740492+0000","last_peered":"2023-08-31T00:27:01.740492+0000","last_clean":"2023-08-31T00:27:01.740492+0000","last_became_active":"2023-08-31T00:27:00.326932+0000","last_became_peered":"2023-08-31T00:27:00.326932+0000","last_unstale":"2023-08-31T00:27:01.740492+0000","last_undegraded":"2023-08-31T00:27:01.740492+0000","last_fullsized":"2023-08-31T00:27:01.740492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741105+0000","last_change":"2023-08-31T00:27:00.313686+0000","last_active":"2023-08-31T00:27:01.741105+0000","last_peered":"2023-08-31T00:27:01.741105+0000","last_clean":"2023-08-31T00:27:01.741105+0000","last_became_active":"2023-08-31T00:27:00.313386+0000","last_became_peered":"2023-08-31T00:27:00.313386+0000","last_unstale":"2023-08-31T00:27:01.741105+0000","last_undegraded":"2023-08-31T00:27:01.741105+0000","last_fullsized":"2023-08-31T00:27:01.741105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:41.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302176+0000","last_change":"2023-08-31T00:27:00.316315+0000","last_active":"2023-08-31T00:27:01.302176+0000","last_peered":"2023-08-31T00:27:01.302176+0000","last_clean":"2023-08-31T00:27:01.302176+0000","last_became_active":"2023-08-31T00:27:00.313982+0000","last_became_peered":"2023-08-31T00:27:00.313982+0000","last_unstale":"2023-08-31T00:27:01.302176+0000","last_undegraded":"2023-08-31T00:27:01.302176+0000","last_fullsized":"2023-08-31T00:27:01.302176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:27:09.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:27:09.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 -- 172.21.15.77:0/3393758547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c071000 msgr2=0x7f3d0c0c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 --2- 172.21.15.77:0/3393758547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c071000 0x7f3d0c0c96b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009f60 tx=0x7f3d04009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:09.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 -- 172.21.15.77:0/3393758547 shutdown_connections 2023-08-31T00:27:09.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 --2- 172.21.15.77:0/3393758547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c071000 0x7f3d0c0c96b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 --2- 172.21.15.77:0/3393758547 >> v2:172.21.15.139:3300/0 conn(0x7f3d0c06f130 0x7f3d0c070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 -- 172.21.15.77:0/3393758547 >> 172.21.15.77:0/3393758547 conn(0x7f3d0c06cbf0 msgr2=0x7f3d0c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 -- 172.21.15.77:0/3393758547 shutdown_connections 2023-08-31T00:27:09.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.595+0000 7f3d13e52700 1 -- 172.21.15.77:0/3393758547 wait complete. 2023-08-31T00:27:09.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 Processor -- start 2023-08-31T00:27:09.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 -- start start 2023-08-31T00:27:09.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 0x7f3d0c152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d0c071000 0x7f3d0c0aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c1580f0 0x7f3d0c069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c1f2ac0 con 0x7f3d0c06f130 2023-08-31T00:27:09.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0ac010 con 0x7f3d0c071000 2023-08-31T00:27:09.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d13e52700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0ab780 con 0x7f3d0c1580f0 2023-08-31T00:27:09.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d11bee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 0x7f3d0c152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d11bee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 0x7f3d0c152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38902/0 (socket says 172.21.15.77:38902) 2023-08-31T00:27:09.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.597+0000 7f3d11bee700 1 -- 172.21.15.77:0/624528940 learned_addr learned my addr 172.21.15.77:0/624528940 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:09.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d123ef700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c1580f0 0x7f3d0c069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d113ed700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d0c071000 0x7f3d0c0aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d11bee700 1 -- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c1580f0 msgr2=0x7f3d0c069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d11bee700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c1580f0 0x7f3d0c069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d11bee700 1 -- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d0c071000 msgr2=0x7f3d0c0aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d11bee700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d0c071000 0x7f3d0c0aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d11bee700 1 -- 172.21.15.77:0/624528940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04009c40 con 0x7f3d0c06f130 2023-08-31T00:27:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d113ed700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d0c071000 0x7f3d0c0aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d123ef700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c1580f0 0x7f3d0c069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d11bee700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 0x7f3d0c152550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c430 tx=0x7f3d0800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:09.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08004230 con 0x7f3d0c06f130 2023-08-31T00:27:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3d080044a0 con 0x7f3d0c06f130 2023-08-31T00:27:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080038e0 con 0x7f3d0c06f130 2023-08-31T00:27:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c0ab1c0 con 0x7f3d0c06f130 2023-08-31T00:27:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.598+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c0abca0 con 0x7f3d0c06f130 2023-08-31T00:27:09.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.599+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c073c30 con 0x7f3d0c06f130 2023-08-31T00:27:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.599+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d08003a40 con 0x7f3d0c06f130 2023-08-31T00:27:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.600+0000 7f3d027fc700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3cf006a0e0 0x7f3cf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.600+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d08087a90 con 0x7f3d0c06f130 2023-08-31T00:27:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.600+0000 7f3d113ed700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3cf006a0e0 0x7f3cf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.600+0000 7f3d113ed700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3cf006a0e0 0x7f3cf006c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0c21a0 tx=0x7f3cfc009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:09.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.604+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3d080531f0 con 0x7f3d0c06f130 2023-08-31T00:27:09.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.789+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d0c1584d0 con 0x7f3cf006a0e0 2023-08-31T00:27:09.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.796+0000 7f3d027fc700 1 -- 172.21.15.77:0/624528940 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264605 (secure 0 0 0) 0x7f3cfc009dc0 con 0x7f3cf006a0e0 2023-08-31T00:27:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:09.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.799+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3cf006a0e0 msgr2=0x7f3cf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.799+0000 7f3d13e52700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3cf006a0e0 0x7f3cf006c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0c21a0 tx=0x7f3cfc009260 comp rx=0 tx=0).stop 2023-08-31T00:27:09.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.799+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 msgr2=0x7f3d0c152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.799+0000 7f3d13e52700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 0x7f3d0c152550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c430 tx=0x7f3d0800c7f0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 shutdown_connections 2023-08-31T00:27:09.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3cf006a0e0 0x7f3cf006c5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3d0c1580f0 0x7f3d0c069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d0c06f130 0x7f3d0c152550 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 --2- 172.21.15.77:0/624528940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d0c071000 0x7f3d0c0aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 >> 172.21.15.77:0/624528940 conn(0x7f3d0c06cbf0 msgr2=0x7f3d0c0cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 shutdown_connections 2023-08-31T00:27:09.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.800+0000 7f3d13e52700 1 -- 172.21.15.77:0/624528940 wait complete. 2023-08-31T00:27:09.805 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:27:09.812 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T00:27:08.118040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2891776,"data_stored":1752740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001828"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741205+0000","last_change":"2023-08-31T00:27:00.316606+0000","last_active":"2023-08-31T00:27:01.741205+0000","last_peered":"2023-08-31T00:27:01.741205+0000","last_clean":"2023-08-31T00:27:01.741205+0000","last_became_active":"2023-08-31T00:27:00.316335+0000","last_became_peered":"2023-08-31T00:27:00.316335+0000","last_unstale":"2023-08-31T00:27:01.741205+0000","last_undegraded":"2023-08-31T00:27:01.741205+0000","last_fullsized":"2023-08-31T00:27:01.741205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:40:38.763036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.300109+0000","last_change":"2023-08-31T00:27:00.319751+0000","last_active":"2023-08-31T00:27:01.300109+0000","last_peered":"2023-08-31T00:27:01.300109+0000","last_clean":"2023-08-31T00:27:01.300109+0000","last_became_active":"2023-08-31T00:27:00.319480+0000","last_became_peered":"2023-08-31T00:27:00.319480+0000","last_unstale":"2023-08-31T00:27:01.300109+0000","last_undegraded":"2023-08-31T00:27:01.300109+0000","last_fullsized":"2023-08-31T00:27:01.300109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741111+0000","last_change":"2023-08-31T00:27:00.314460+0000","last_active":"2023-08-31T00:27:01.741111+0000","last_peered":"2023-08-31T00:27:01.741111+0000","last_clean":"2023-08-31T00:27:01.741111+0000","last_became_active":"2023-08-31T00:27:00.314165+0000","last_became_peered":"2023-08-31T00:27:00.314165+0000","last_unstale":"2023-08-31T00:27:01.741111+0000","last_undegraded":"2023-08-31T00:27:01.741111+0000","last_fullsized":"2023-08-31T00:27:01.741111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741342+0000","last_change":"2023-08-31T00:27:00.330366+0000","last_active":"2023-08-31T00:27:01.741342+0000","last_peered":"2023-08-31T00:27:01.741342+0000","last_clean":"2023-08-31T00:27:01.741342+0000","last_became_active":"2023-08-31T00:27:00.330034+0000","last_became_peered":"2023-08-31T00:27:00.330034+0000","last_unstale":"2023-08-31T00:27:01.741342+0000","last_undegraded":"2023-08-31T00:27:01.741342+0000","last_fullsized":"2023-08-31T00:27:01.741342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:02:32.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740734+0000","last_change":"2023-08-31T00:27:00.315980+0000","last_active":"2023-08-31T00:27:01.740734+0000","last_peered":"2023-08-31T00:27:01.740734+0000","last_clean":"2023-08-31T00:27:01.740734+0000","last_became_active":"2023-08-31T00:27:00.315408+0000","last_became_peered":"2023-08-31T00:27:00.315408+0000","last_unstale":"2023-08-31T00:27:01.740734+0000","last_undegraded":"2023-08-31T00:27:01.740734+0000","last_fullsized":"2023-08-31T00:27:01.740734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:57:04.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740756+0000","last_change":"2023-08-31T00:27:00.327757+0000","last_active":"2023-08-31T00:27:01.740756+0000","last_peered":"2023-08-31T00:27:01.740756+0000","last_clean":"2023-08-31T00:27:01.740756+0000","last_became_active":"2023-08-31T00:27:00.327504+0000","last_became_peered":"2023-08-31T00:27:00.327504+0000","last_unstale":"2023-08-31T00:27:01.740756+0000","last_undegraded":"2023-08-31T00:27:01.740756+0000","last_fullsized":"2023-08-31T00:27:01.740756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:01:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740669+0000","last_change":"2023-08-31T00:27:00.319958+0000","last_active":"2023-08-31T00:27:01.740669+0000","last_peered":"2023-08-31T00:27:01.740669+0000","last_clean":"2023-08-31T00:27:01.740669+0000","last_became_active":"2023-08-31T00:27:00.319594+0000","last_became_peered":"2023-08-31T00:27:00.319594+0000","last_unstale":"2023-08-31T00:27:01.740669+0000","last_undegraded":"2023-08-31T00:27:01.740669+0000","last_fullsized":"2023-08-31T00:27:01.740669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:01:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740385+0000","last_change":"2023-08-31T00:27:00.327585+0000","last_active":"2023-08-31T00:27:01.740385+0000","last_peered":"2023-08-31T00:27:01.740385+0000","last_clean":"2023-08-31T00:27:01.740385+0000","last_became_active":"2023-08-31T00:27:00.324961+0000","last_became_peered":"2023-08-31T00:27:00.324961+0000","last_unstale":"2023-08-31T00:27:01.740385+0000","last_undegraded":"2023-08-31T00:27:01.740385+0000","last_fullsized":"2023-08-31T00:27:01.740385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741358+0000","last_change":"2023-08-31T00:27:00.325501+0000","last_active":"2023-08-31T00:27:01.741358+0000","last_peered":"2023-08-31T00:27:01.741358+0000","last_clean":"2023-08-31T00:27:01.741358+0000","last_became_active":"2023-08-31T00:27:00.325229+0000","last_became_peered":"2023-08-31T00:27:00.325229+0000","last_unstale":"2023-08-31T00:27:01.741358+0000","last_undegraded":"2023-08-31T00:27:01.741358+0000","last_fullsized":"2023-08-31T00:27:01.741358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:51.688515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.303071+0000","last_change":"2023-08-31T00:27:00.324789+0000","last_active":"2023-08-31T00:27:01.303071+0000","last_peered":"2023-08-31T00:27:01.303071+0000","last_clean":"2023-08-31T00:27:01.303071+0000","last_became_active":"2023-08-31T00:27:00.324505+0000","last_became_peered":"2023-08-31T00:27:00.324505+0000","last_unstale":"2023-08-31T00:27:01.303071+0000","last_undegraded":"2023-08-31T00:27:01.303071+0000","last_fullsized":"2023-08-31T00:27:01.303071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302274+0000","last_change":"2023-08-31T00:27:00.324716+0000","last_active":"2023-08-31T00:27:01.302274+0000","last_peered":"2023-08-31T00:27:01.302274+0000","last_clean":"2023-08-31T00:27:01.302274+0000","last_became_active":"2023-08-31T00:27:00.324443+0000","last_became_peered":"2023-08-31T00:27:00.324443+0000","last_unstale":"2023-08-31T00:27:01.302274+0000","last_undegraded":"2023-08-31T00:27:01.302274+0000","last_fullsized":"2023-08-31T00:27:01.302274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302552+0000","last_change":"2023-08-31T00:27:00.312173+0000","last_active":"2023-08-31T00:27:01.302552+0000","last_peered":"2023-08-31T00:27:01.302552+0000","last_clean":"2023-08-31T00:27:01.302552+0000","last_became_active":"2023-08-31T00:27:00.311885+0000","last_became_peered":"2023-08-31T00:27:00.311885+0000","last_unstale":"2023-08-31T00:27:01.302552+0000","last_undegraded":"2023-08-31T00:27:01.302552+0000","last_fullsized":"2023-08-31T00:27:01.302552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:13:00.373032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740589+0000","last_change":"2023-08-31T00:27:00.323165+0000","last_active":"2023-08-31T00:27:01.740589+0000","last_peered":"2023-08-31T00:27:01.740589+0000","last_clean":"2023-08-31T00:27:01.740589+0000","last_became_active":"2023-08-31T00:27:00.322854+0000","last_became_peered":"2023-08-31T00:27:00.322854+0000","last_unstale":"2023-08-31T00:27:01.740589+0000","last_undegraded":"2023-08-31T00:27:01.740589+0000","last_fullsized":"2023-08-31T00:27:01.740589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741248+0000","last_change":"2023-08-31T00:27:00.312986+0000","last_active":"2023-08-31T00:27:01.741248+0000","last_peered":"2023-08-31T00:27:01.741248+0000","last_clean":"2023-08-31T00:27:01.741248+0000","last_became_active":"2023-08-31T00:27:00.312500+0000","last_became_peered":"2023-08-31T00:27:00.312500+0000","last_unstale":"2023-08-31T00:27:01.741248+0000","last_undegraded":"2023-08-31T00:27:01.741248+0000","last_fullsized":"2023-08-31T00:27:01.741248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299787+0000","last_change":"2023-08-31T00:27:00.314835+0000","last_active":"2023-08-31T00:27:01.299787+0000","last_peered":"2023-08-31T00:27:01.299787+0000","last_clean":"2023-08-31T00:27:01.299787+0000","last_became_active":"2023-08-31T00:27:00.314578+0000","last_became_peered":"2023-08-31T00:27:00.314578+0000","last_unstale":"2023-08-31T00:27:01.299787+0000","last_undegraded":"2023-08-31T00:27:01.299787+0000","last_fullsized":"2023-08-31T00:27:01.299787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741046+0000","last_change":"2023-08-31T00:27:00.327680+0000","last_active":"2023-08-31T00:27:01.741046+0000","last_peered":"2023-08-31T00:27:01.741046+0000","last_clean":"2023-08-31T00:27:01.741046+0000","last_became_active":"2023-08-31T00:27:00.327418+0000","last_became_peered":"2023-08-31T00:27:00.327418+0000","last_unstale":"2023-08-31T00:27:01.741046+0000","last_undegraded":"2023-08-31T00:27:01.741046+0000","last_fullsized":"2023-08-31T00:27:01.741046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:57:04.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741479+0000","last_change":"2023-08-31T00:27:00.327254+0000","last_active":"2023-08-31T00:27:01.741479+0000","last_peered":"2023-08-31T00:27:01.741479+0000","last_clean":"2023-08-31T00:27:01.741479+0000","last_became_active":"2023-08-31T00:27:00.326713+0000","last_became_peered":"2023-08-31T00:27:00.326713+0000","last_unstale":"2023-08-31T00:27:01.741479+0000","last_undegraded":"2023-08-31T00:27:01.741479+0000","last_fullsized":"2023-08-31T00:27:01.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:51.688515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740625+0000","last_change":"2023-08-31T00:27:00.303375+0000","last_active":"2023-08-31T00:27:01.740625+0000","last_peered":"2023-08-31T00:27:01.740625+0000","last_clean":"2023-08-31T00:27:01.740625+0000","last_became_active":"2023-08-31T00:27:00.303086+0000","last_became_peered":"2023-08-31T00:27:00.303086+0000","last_unstale":"2023-08-31T00:27:01.740625+0000","last_undegraded":"2023-08-31T00:27:01.740625+0000","last_fullsized":"2023-08-31T00:27:01.740625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:34.505901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741433+0000","last_change":"2023-08-31T00:27:00.315115+0000","last_active":"2023-08-31T00:27:01.741433+0000","last_peered":"2023-08-31T00:27:01.741433+0000","last_clean":"2023-08-31T00:27:01.741433+0000","last_became_active":"2023-08-31T00:27:00.314835+0000","last_became_peered":"2023-08-31T00:27:00.314835+0000","last_unstale":"2023-08-31T00:27:01.741433+0000","last_undegraded":"2023-08-31T00:27:01.741433+0000","last_fullsized":"2023-08-31T00:27:01.741433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:05:57.152112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128207+0000","last_change":"2023-08-31T00:26:59.319947+0000","last_active":"2023-08-31T00:27:01.128207+0000","last_peered":"2023-08-31T00:27:01.128207+0000","last_clean":"2023-08-31T00:27:01.128207+0000","last_became_active":"2023-08-31T00:26:59.319620+0000","last_became_peered":"2023-08-31T00:26:59.319620+0000","last_unstale":"2023-08-31T00:27:01.128207+0000","last_undegraded":"2023-08-31T00:27:01.128207+0000","last_fullsized":"2023-08-31T00:27:01.128207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740780+0000","last_change":"2023-08-31T00:27:00.318524+0000","last_active":"2023-08-31T00:27:01.740780+0000","last_peered":"2023-08-31T00:27:01.740780+0000","last_clean":"2023-08-31T00:27:01.740780+0000","last_became_active":"2023-08-31T00:27:00.318265+0000","last_became_peered":"2023-08-31T00:27:00.318265+0000","last_unstale":"2023-08-31T00:27:01.740780+0000","last_undegraded":"2023-08-31T00:27:01.740780+0000","last_fullsized":"2023-08-31T00:27:01.740780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128305+0000","last_change":"2023-08-31T00:26:59.307239+0000","last_active":"2023-08-31T00:27:01.128305+0000","last_peered":"2023-08-31T00:27:01.128305+0000","last_clean":"2023-08-31T00:27:01.128305+0000","last_became_active":"2023-08-31T00:26:59.306693+0000","last_became_peered":"2023-08-31T00:26:59.306693+0000","last_unstale":"2023-08-31T00:27:01.128305+0000","last_undegraded":"2023-08-31T00:27:01.128305+0000","last_fullsized":"2023-08-31T00:27:01.128305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741087+0000","last_change":"2023-08-31T00:27:00.324786+0000","last_active":"2023-08-31T00:27:01.741087+0000","last_peered":"2023-08-31T00:27:01.741087+0000","last_clean":"2023-08-31T00:27:01.741087+0000","last_became_active":"2023-08-31T00:27:00.324524+0000","last_became_peered":"2023-08-31T00:27:00.324524+0000","last_unstale":"2023-08-31T00:27:01.741087+0000","last_undegraded":"2023-08-31T00:27:01.741087+0000","last_fullsized":"2023-08-31T00:27:01.741087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126879+0000","last_change":"2023-08-31T00:26:59.326328+0000","last_active":"2023-08-31T00:27:01.126879+0000","last_peered":"2023-08-31T00:27:01.126879+0000","last_clean":"2023-08-31T00:27:01.126879+0000","last_became_active":"2023-08-31T00:26:59.326028+0000","last_became_peered":"2023-08-31T00:26:59.326028+0000","last_unstale":"2023-08-31T00:27:01.126879+0000","last_undegraded":"2023-08-31T00:27:01.126879+0000","last_fullsized":"2023-08-31T00:27:01.126879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741079+0000","last_change":"2023-08-31T00:27:00.321637+0000","last_active":"2023-08-31T00:27:01.741079+0000","last_peered":"2023-08-31T00:27:01.741079+0000","last_clean":"2023-08-31T00:27:01.741079+0000","last_became_active":"2023-08-31T00:27:00.321377+0000","last_became_peered":"2023-08-31T00:27:00.321377+0000","last_unstale":"2023-08-31T00:27:01.741079+0000","last_undegraded":"2023-08-31T00:27:01.741079+0000","last_fullsized":"2023-08-31T00:27:01.741079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:09:48.611438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126810+0000","last_change":"2023-08-31T00:26:59.326471+0000","last_active":"2023-08-31T00:27:01.126810+0000","last_peered":"2023-08-31T00:27:01.126810+0000","last_clean":"2023-08-31T00:27:01.126810+0000","last_became_active":"2023-08-31T00:26:59.326163+0000","last_became_peered":"2023-08-31T00:26:59.326163+0000","last_unstale":"2023-08-31T00:27:01.126810+0000","last_undegraded":"2023-08-31T00:27:01.126810+0000","last_fullsized":"2023-08-31T00:27:01.126810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741431+0000","last_change":"2023-08-31T00:27:00.322301+0000","last_active":"2023-08-31T00:27:01.741431+0000","last_peered":"2023-08-31T00:27:01.741431+0000","last_clean":"2023-08-31T00:27:01.741431+0000","last_became_active":"2023-08-31T00:27:00.321299+0000","last_became_peered":"2023-08-31T00:27:00.321299+0000","last_unstale":"2023-08-31T00:27:01.741431+0000","last_undegraded":"2023-08-31T00:27:01.741431+0000","last_fullsized":"2023-08-31T00:27:01.741431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:40:38.763036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128268+0000","last_change":"2023-08-31T00:26:59.316902+0000","last_active":"2023-08-31T00:27:01.128268+0000","last_peered":"2023-08-31T00:27:01.128268+0000","last_clean":"2023-08-31T00:27:01.128268+0000","last_became_active":"2023-08-31T00:26:59.316643+0000","last_became_peered":"2023-08-31T00:26:59.316643+0000","last_unstale":"2023-08-31T00:27:01.128268+0000","last_undegraded":"2023-08-31T00:27:01.128268+0000","last_fullsized":"2023-08-31T00:27:01.128268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:42.963922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302177+0000","last_change":"2023-08-31T00:27:00.316602+0000","last_active":"2023-08-31T00:27:01.302177+0000","last_peered":"2023-08-31T00:27:01.302177+0000","last_clean":"2023-08-31T00:27:01.302177+0000","last_became_active":"2023-08-31T00:27:00.316285+0000","last_became_peered":"2023-08-31T00:27:00.316285+0000","last_unstale":"2023-08-31T00:27:01.302177+0000","last_undegraded":"2023-08-31T00:27:01.302177+0000","last_fullsized":"2023-08-31T00:27:01.302177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:56.296115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126465+0000","last_change":"2023-08-31T00:26:59.314263+0000","last_active":"2023-08-31T00:27:01.126465+0000","last_peered":"2023-08-31T00:27:01.126465+0000","last_clean":"2023-08-31T00:27:01.126465+0000","last_became_active":"2023-08-31T00:26:59.314015+0000","last_became_peered":"2023-08-31T00:26:59.314015+0000","last_unstale":"2023-08-31T00:27:01.126465+0000","last_undegraded":"2023-08-31T00:27:01.126465+0000","last_fullsized":"2023-08-31T00:27:01.126465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741442+0000","last_change":"2023-08-31T00:27:00.315878+0000","last_active":"2023-08-31T00:27:01.741442+0000","last_peered":"2023-08-31T00:27:01.741442+0000","last_clean":"2023-08-31T00:27:01.741442+0000","last_became_active":"2023-08-31T00:27:00.315491+0000","last_became_peered":"2023-08-31T00:27:00.315491+0000","last_unstale":"2023-08-31T00:27:01.741442+0000","last_undegraded":"2023-08-31T00:27:01.741442+0000","last_fullsized":"2023-08-31T00:27:01.741442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128184+0000","last_change":"2023-08-31T00:26:59.313625+0000","last_active":"2023-08-31T00:27:01.128184+0000","last_peered":"2023-08-31T00:27:01.128184+0000","last_clean":"2023-08-31T00:27:01.128184+0000","last_became_active":"2023-08-31T00:26:59.313352+0000","last_became_peered":"2023-08-31T00:26:59.313352+0000","last_unstale":"2023-08-31T00:27:01.128184+0000","last_undegraded":"2023-08-31T00:27:01.128184+0000","last_fullsized":"2023-08-31T00:27:01.128184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740986+0000","last_change":"2023-08-31T00:27:00.328716+0000","last_active":"2023-08-31T00:27:01.740986+0000","last_peered":"2023-08-31T00:27:01.740986+0000","last_clean":"2023-08-31T00:27:01.740986+0000","last_became_active":"2023-08-31T00:27:00.328462+0000","last_became_peered":"2023-08-31T00:27:00.328462+0000","last_unstale":"2023-08-31T00:27:01.740986+0000","last_undegraded":"2023-08-31T00:27:01.740986+0000","last_fullsized":"2023-08-31T00:27:01.740986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:09:48.611438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133575+0000","last_change":"2023-08-31T00:26:59.318075+0000","last_active":"2023-08-31T00:27:01.133575+0000","last_peered":"2023-08-31T00:27:01.133575+0000","last_clean":"2023-08-31T00:27:01.133575+0000","last_became_active":"2023-08-31T00:26:59.314966+0000","last_became_peered":"2023-08-31T00:26:59.314966+0000","last_unstale":"2023-08-31T00:27:01.133575+0000","last_undegraded":"2023-08-31T00:27:01.133575+0000","last_fullsized":"2023-08-31T00:27:01.133575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299954+0000","last_change":"2023-08-31T00:27:00.322612+0000","last_active":"2023-08-31T00:27:01.299954+0000","last_peered":"2023-08-31T00:27:01.299954+0000","last_clean":"2023-08-31T00:27:01.299954+0000","last_became_active":"2023-08-31T00:27:00.322332+0000","last_became_peered":"2023-08-31T00:27:00.322332+0000","last_unstale":"2023-08-31T00:27:01.299954+0000","last_undegraded":"2023-08-31T00:27:01.299954+0000","last_fullsized":"2023-08-31T00:27:01.299954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126573+0000","last_change":"2023-08-31T00:26:59.317148+0000","last_active":"2023-08-31T00:27:01.126573+0000","last_peered":"2023-08-31T00:27:01.126573+0000","last_clean":"2023-08-31T00:27:01.126573+0000","last_became_active":"2023-08-31T00:26:59.316679+0000","last_became_peered":"2023-08-31T00:26:59.316679+0000","last_unstale":"2023-08-31T00:27:01.126573+0000","last_undegraded":"2023-08-31T00:27:01.126573+0000","last_fullsized":"2023-08-31T00:27:01.126573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741575+0000","last_change":"2023-08-31T00:27:00.327124+0000","last_active":"2023-08-31T00:27:01.741575+0000","last_peered":"2023-08-31T00:27:01.741575+0000","last_clean":"2023-08-31T00:27:01.741575+0000","last_became_active":"2023-08-31T00:27:00.326440+0000","last_became_peered":"2023-08-31T00:27:00.326440+0000","last_unstale":"2023-08-31T00:27:01.741575+0000","last_undegraded":"2023-08-31T00:27:01.741575+0000","last_fullsized":"2023-08-31T00:27:01.741575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:26:26.978175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133765+0000","last_change":"2023-08-31T00:26:59.319209+0000","last_active":"2023-08-31T00:27:01.133765+0000","last_peered":"2023-08-31T00:27:01.133765+0000","last_clean":"2023-08-31T00:27:01.133765+0000","last_became_active":"2023-08-31T00:26:59.318940+0000","last_became_peered":"2023-08-31T00:26:59.318940+0000","last_unstale":"2023-08-31T00:27:01.133765+0000","last_undegraded":"2023-08-31T00:27:01.133765+0000","last_fullsized":"2023-08-31T00:27:01.133765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:14.443886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741437+0000","last_change":"2023-08-31T00:27:00.321858+0000","last_active":"2023-08-31T00:27:01.741437+0000","last_peered":"2023-08-31T00:27:01.741437+0000","last_clean":"2023-08-31T00:27:01.741437+0000","last_became_active":"2023-08-31T00:27:00.321595+0000","last_became_peered":"2023-08-31T00:27:00.321595+0000","last_unstale":"2023-08-31T00:27:01.741437+0000","last_undegraded":"2023-08-31T00:27:01.741437+0000","last_fullsized":"2023-08-31T00:27:01.741437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132325+0000","last_change":"2023-08-31T00:26:59.317069+0000","last_active":"2023-08-31T00:27:01.132325+0000","last_peered":"2023-08-31T00:27:01.132325+0000","last_clean":"2023-08-31T00:27:01.132325+0000","last_became_active":"2023-08-31T00:26:59.316783+0000","last_became_peered":"2023-08-31T00:26:59.316783+0000","last_unstale":"2023-08-31T00:27:01.132325+0000","last_undegraded":"2023-08-31T00:27:01.132325+0000","last_fullsized":"2023-08-31T00:27:01.132325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:20:12.495239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302548+0000","last_change":"2023-08-31T00:27:00.317789+0000","last_active":"2023-08-31T00:27:01.302548+0000","last_peered":"2023-08-31T00:27:01.302548+0000","last_clean":"2023-08-31T00:27:01.302548+0000","last_became_active":"2023-08-31T00:27:00.317275+0000","last_became_peered":"2023-08-31T00:27:00.317275+0000","last_unstale":"2023-08-31T00:27:01.302548+0000","last_undegraded":"2023-08-31T00:27:01.302548+0000","last_fullsized":"2023-08-31T00:27:01.302548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:55.810080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126490+0000","last_change":"2023-08-31T00:26:59.310802+0000","last_active":"2023-08-31T00:27:01.126490+0000","last_peered":"2023-08-31T00:27:01.126490+0000","last_clean":"2023-08-31T00:27:01.126490+0000","last_became_active":"2023-08-31T00:26:59.310150+0000","last_became_peered":"2023-08-31T00:26:59.310150+0000","last_unstale":"2023-08-31T00:27:01.126490+0000","last_undegraded":"2023-08-31T00:27:01.126490+0000","last_fullsized":"2023-08-31T00:27:01.126490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:08.209646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741481+0000","last_change":"2023-08-31T00:27:00.324514+0000","last_active":"2023-08-31T00:27:01.741481+0000","last_peered":"2023-08-31T00:27:01.741481+0000","last_clean":"2023-08-31T00:27:01.741481+0000","last_became_active":"2023-08-31T00:27:00.324137+0000","last_became_peered":"2023-08-31T00:27:00.324137+0000","last_unstale":"2023-08-31T00:27:01.741481+0000","last_undegraded":"2023-08-31T00:27:01.741481+0000","last_fullsized":"2023-08-31T00:27:01.741481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:26:26.978175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.128145+0000","last_change":"2023-08-31T00:26:59.308265+0000","last_active":"2023-08-31T00:27:01.128145+0000","last_peered":"2023-08-31T00:27:01.128145+0000","last_clean":"2023-08-31T00:27:01.128145+0000","last_became_active":"2023-08-31T00:26:59.307956+0000","last_became_peered":"2023-08-31T00:26:59.307956+0000","last_unstale":"2023-08-31T00:27:01.128145+0000","last_undegraded":"2023-08-31T00:27:01.128145+0000","last_fullsized":"2023-08-31T00:27:01.128145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741109+0000","last_change":"2023-08-31T00:27:00.314782+0000","last_active":"2023-08-31T00:27:01.741109+0000","last_peered":"2023-08-31T00:27:01.741109+0000","last_clean":"2023-08-31T00:27:01.741109+0000","last_became_active":"2023-08-31T00:27:00.314505+0000","last_became_peered":"2023-08-31T00:27:00.314505+0000","last_unstale":"2023-08-31T00:27:01.741109+0000","last_undegraded":"2023-08-31T00:27:01.741109+0000","last_fullsized":"2023-08-31T00:27:01.741109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133668+0000","last_change":"2023-08-31T00:26:59.320415+0000","last_active":"2023-08-31T00:27:01.133668+0000","last_peered":"2023-08-31T00:27:01.133668+0000","last_clean":"2023-08-31T00:27:01.133668+0000","last_became_active":"2023-08-31T00:26:59.319939+0000","last_became_peered":"2023-08-31T00:26:59.319939+0000","last_unstale":"2023-08-31T00:27:01.133668+0000","last_undegraded":"2023-08-31T00:27:01.133668+0000","last_fullsized":"2023-08-31T00:27:01.133668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:08.276952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741714+0000","last_change":"2023-08-31T00:27:00.316185+0000","last_active":"2023-08-31T00:27:01.741714+0000","last_peered":"2023-08-31T00:27:01.741714+0000","last_clean":"2023-08-31T00:27:01.741714+0000","last_became_active":"2023-08-31T00:27:00.315707+0000","last_became_peered":"2023-08-31T00:27:00.315707+0000","last_unstale":"2023-08-31T00:27:01.741714+0000","last_undegraded":"2023-08-31T00:27:01.741714+0000","last_fullsized":"2023-08-31T00:27:01.741714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:47:01.340345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126442+0000","last_change":"2023-08-31T00:26:59.313185+0000","last_active":"2023-08-31T00:27:01.126442+0000","last_peered":"2023-08-31T00:27:01.126442+0000","last_clean":"2023-08-31T00:27:01.126442+0000","last_became_active":"2023-08-31T00:26:59.312883+0000","last_became_peered":"2023-08-31T00:26:59.312883+0000","last_unstale":"2023-08-31T00:27:01.126442+0000","last_undegraded":"2023-08-31T00:27:01.126442+0000","last_fullsized":"2023-08-31T00:27:01.126442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301538+0000","last_change":"2023-08-31T00:27:00.307379+0000","last_active":"2023-08-31T00:27:01.301538+0000","last_peered":"2023-08-31T00:27:01.301538+0000","last_clean":"2023-08-31T00:27:01.301538+0000","last_became_active":"2023-08-31T00:27:00.307055+0000","last_became_peered":"2023-08-31T00:27:00.307055+0000","last_unstale":"2023-08-31T00:27:01.301538+0000","last_undegraded":"2023-08-31T00:27:01.301538+0000","last_fullsized":"2023-08-31T00:27:01.301538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:54.790846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134418+0000","last_change":"2023-08-31T00:26:59.312847+0000","last_active":"2023-08-31T00:27:01.134418+0000","last_peered":"2023-08-31T00:27:01.134418+0000","last_clean":"2023-08-31T00:27:01.134418+0000","last_became_active":"2023-08-31T00:26:59.312546+0000","last_became_peered":"2023-08-31T00:26:59.312546+0000","last_unstale":"2023-08-31T00:27:01.134418+0000","last_undegraded":"2023-08-31T00:27:01.134418+0000","last_fullsized":"2023-08-31T00:27:01.134418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740920+0000","last_change":"2023-08-31T00:27:00.314713+0000","last_active":"2023-08-31T00:27:01.740920+0000","last_peered":"2023-08-31T00:27:01.740920+0000","last_clean":"2023-08-31T00:27:01.740920+0000","last_became_active":"2023-08-31T00:27:00.314421+0000","last_became_peered":"2023-08-31T00:27:00.314421+0000","last_unstale":"2023-08-31T00:27:01.740920+0000","last_undegraded":"2023-08-31T00:27:01.740920+0000","last_fullsized":"2023-08-31T00:27:01.740920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:09:48.611438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132990+0000","last_change":"2023-08-31T00:26:59.315973+0000","last_active":"2023-08-31T00:27:01.132990+0000","last_peered":"2023-08-31T00:27:01.132990+0000","last_clean":"2023-08-31T00:27:01.132990+0000","last_became_active":"2023-08-31T00:26:59.315513+0000","last_became_peered":"2023-08-31T00:26:59.315513+0000","last_unstale":"2023-08-31T00:27:01.132990+0000","last_undegraded":"2023-08-31T00:27:01.132990+0000","last_fullsized":"2023-08-31T00:27:01.132990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:08:02.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740953+0000","last_change":"2023-08-31T00:27:00.314705+0000","last_active":"2023-08-31T00:27:01.740953+0000","last_peered":"2023-08-31T00:27:01.740953+0000","last_clean":"2023-08-31T00:27:01.740953+0000","last_became_active":"2023-08-31T00:27:00.314428+0000","last_became_peered":"2023-08-31T00:27:00.314428+0000","last_unstale":"2023-08-31T00:27:01.740953+0000","last_undegraded":"2023-08-31T00:27:01.740953+0000","last_fullsized":"2023-08-31T00:27:01.740953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:02:32.106443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132289+0000","last_change":"2023-08-31T00:26:59.311823+0000","last_active":"2023-08-31T00:27:01.132289+0000","last_peered":"2023-08-31T00:27:01.132289+0000","last_clean":"2023-08-31T00:27:01.132289+0000","last_became_active":"2023-08-31T00:26:59.311483+0000","last_became_peered":"2023-08-31T00:26:59.311483+0000","last_unstale":"2023-08-31T00:27:01.132289+0000","last_undegraded":"2023-08-31T00:27:01.132289+0000","last_fullsized":"2023-08-31T00:27:01.132289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741582+0000","last_change":"2023-08-31T00:27:00.325548+0000","last_active":"2023-08-31T00:27:01.741582+0000","last_peered":"2023-08-31T00:27:01.741582+0000","last_clean":"2023-08-31T00:27:01.741582+0000","last_became_active":"2023-08-31T00:27:00.325055+0000","last_became_peered":"2023-08-31T00:27:00.325055+0000","last_unstale":"2023-08-31T00:27:01.741582+0000","last_undegraded":"2023-08-31T00:27:01.741582+0000","last_fullsized":"2023-08-31T00:27:01.741582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:05:57.152112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133654+0000","last_change":"2023-08-31T00:26:59.318639+0000","last_active":"2023-08-31T00:27:01.133654+0000","last_peered":"2023-08-31T00:27:01.133654+0000","last_clean":"2023-08-31T00:27:01.133654+0000","last_became_active":"2023-08-31T00:26:59.318291+0000","last_became_peered":"2023-08-31T00:26:59.318291+0000","last_unstale":"2023-08-31T00:27:01.133654+0000","last_undegraded":"2023-08-31T00:27:01.133654+0000","last_fullsized":"2023-08-31T00:27:01.133654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:13.686865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301621+0000","last_change":"2023-08-31T00:27:00.328847+0000","last_active":"2023-08-31T00:27:01.301621+0000","last_peered":"2023-08-31T00:27:01.301621+0000","last_clean":"2023-08-31T00:27:01.301621+0000","last_became_active":"2023-08-31T00:27:00.328588+0000","last_became_peered":"2023-08-31T00:27:00.328588+0000","last_unstale":"2023-08-31T00:27:01.301621+0000","last_undegraded":"2023-08-31T00:27:01.301621+0000","last_fullsized":"2023-08-31T00:27:01.301621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:39.021705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299745+0000","last_change":"2023-08-31T00:27:00.319649+0000","last_active":"2023-08-31T00:27:01.299745+0000","last_peered":"2023-08-31T00:27:01.299745+0000","last_clean":"2023-08-31T00:27:01.299745+0000","last_became_active":"2023-08-31T00:27:00.319365+0000","last_became_peered":"2023-08-31T00:27:00.319365+0000","last_unstale":"2023-08-31T00:27:01.299745+0000","last_undegraded":"2023-08-31T00:27:01.299745+0000","last_fullsized":"2023-08-31T00:27:01.299745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134434+0000","last_change":"2023-08-31T00:26:59.314564+0000","last_active":"2023-08-31T00:27:01.134434+0000","last_peered":"2023-08-31T00:27:01.134434+0000","last_clean":"2023-08-31T00:27:01.134434+0000","last_became_active":"2023-08-31T00:26:59.314296+0000","last_became_peered":"2023-08-31T00:26:59.314296+0000","last_unstale":"2023-08-31T00:27:01.134434+0000","last_undegraded":"2023-08-31T00:27:01.134434+0000","last_fullsized":"2023-08-31T00:27:01.134434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:44:06.610718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740631+0000","last_change":"2023-08-31T00:27:00.329442+0000","last_active":"2023-08-31T00:27:01.740631+0000","last_peered":"2023-08-31T00:27:01.740631+0000","last_clean":"2023-08-31T00:27:01.740631+0000","last_became_active":"2023-08-31T00:27:00.329237+0000","last_became_peered":"2023-08-31T00:27:00.329237+0000","last_unstale":"2023-08-31T00:27:01.740631+0000","last_undegraded":"2023-08-31T00:27:01.740631+0000","last_fullsized":"2023-08-31T00:27:01.740631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:35.008667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.133681+0000","last_change":"2023-08-31T00:26:59.314864+0000","last_active":"2023-08-31T00:27:01.133681+0000","last_peered":"2023-08-31T00:27:01.133681+0000","last_clean":"2023-08-31T00:27:01.133681+0000","last_became_active":"2023-08-31T00:26:59.313879+0000","last_became_peered":"2023-08-31T00:26:59.313879+0000","last_unstale":"2023-08-31T00:27:01.133681+0000","last_undegraded":"2023-08-31T00:27:01.133681+0000","last_fullsized":"2023-08-31T00:27:01.133681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:06:53.782002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:00.304738+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:27:00.304738+0000","last_peered":"2023-08-31T00:27:00.304738+0000","last_clean":"2023-08-31T00:27:00.304738+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:27:00.304738+0000","last_undegraded":"2023-08-31T00:27:00.304738+0000","last_fullsized":"2023-08-31T00:27:00.304738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740268+0000","last_change":"2023-08-31T00:27:00.315831+0000","last_active":"2023-08-31T00:27:01.740268+0000","last_peered":"2023-08-31T00:27:01.740268+0000","last_clean":"2023-08-31T00:27:01.740268+0000","last_became_active":"2023-08-31T00:27:00.315547+0000","last_became_peered":"2023-08-31T00:27:00.315547+0000","last_unstale":"2023-08-31T00:27:01.740268+0000","last_undegraded":"2023-08-31T00:27:01.740268+0000","last_fullsized":"2023-08-31T00:27:01.740268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126723+0000","last_change":"2023-08-31T00:26:59.323394+0000","last_active":"2023-08-31T00:27:01.126723+0000","last_peered":"2023-08-31T00:27:01.126723+0000","last_clean":"2023-08-31T00:27:01.126723+0000","last_became_active":"2023-08-31T00:26:59.323150+0000","last_became_peered":"2023-08-31T00:26:59.323150+0000","last_unstale":"2023-08-31T00:27:01.126723+0000","last_undegraded":"2023-08-31T00:27:01.126723+0000","last_fullsized":"2023-08-31T00:27:01.126723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126865+0000","last_change":"2023-08-31T00:26:59.323065+0000","last_active":"2023-08-31T00:27:01.126865+0000","last_peered":"2023-08-31T00:27:01.126865+0000","last_clean":"2023-08-31T00:27:01.126865+0000","last_became_active":"2023-08-31T00:26:59.322673+0000","last_became_peered":"2023-08-31T00:26:59.322673+0000","last_unstale":"2023-08-31T00:27:01.126865+0000","last_undegraded":"2023-08-31T00:27:01.126865+0000","last_fullsized":"2023-08-31T00:27:01.126865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:40.171611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299875+0000","last_change":"2023-08-31T00:27:00.319918+0000","last_active":"2023-08-31T00:27:01.299875+0000","last_peered":"2023-08-31T00:27:01.299875+0000","last_clean":"2023-08-31T00:27:01.299875+0000","last_became_active":"2023-08-31T00:27:00.319656+0000","last_became_peered":"2023-08-31T00:27:00.319656+0000","last_unstale":"2023-08-31T00:27:01.299875+0000","last_undegraded":"2023-08-31T00:27:01.299875+0000","last_fullsized":"2023-08-31T00:27:01.299875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.300007+0000","last_change":"2023-08-31T00:26:59.316728+0000","last_active":"2023-08-31T00:27:01.300007+0000","last_peered":"2023-08-31T00:27:01.300007+0000","last_clean":"2023-08-31T00:27:01.300007+0000","last_became_active":"2023-08-31T00:26:59.316325+0000","last_became_peered":"2023-08-31T00:26:59.316325+0000","last_unstale":"2023-08-31T00:27:01.300007+0000","last_undegraded":"2023-08-31T00:27:01.300007+0000","last_fullsized":"2023-08-31T00:27:01.300007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741118+0000","last_change":"2023-08-31T00:27:00.317323+0000","last_active":"2023-08-31T00:27:01.741118+0000","last_peered":"2023-08-31T00:27:01.741118+0000","last_clean":"2023-08-31T00:27:01.741118+0000","last_became_active":"2023-08-31T00:27:00.317051+0000","last_became_peered":"2023-08-31T00:27:00.317051+0000","last_unstale":"2023-08-31T00:27:01.741118+0000","last_undegraded":"2023-08-31T00:27:01.741118+0000","last_fullsized":"2023-08-31T00:27:01.741118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:14:43.010670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126559+0000","last_change":"2023-08-31T00:26:59.319291+0000","last_active":"2023-08-31T00:27:01.126559+0000","last_peered":"2023-08-31T00:27:01.126559+0000","last_clean":"2023-08-31T00:27:01.126559+0000","last_became_active":"2023-08-31T00:26:59.318911+0000","last_became_peered":"2023-08-31T00:26:59.318911+0000","last_unstale":"2023-08-31T00:27:01.126559+0000","last_undegraded":"2023-08-31T00:27:01.126559+0000","last_fullsized":"2023-08-31T00:27:01.126559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741325+0000","last_change":"2023-08-31T00:27:00.315232+0000","last_active":"2023-08-31T00:27:01.741325+0000","last_peered":"2023-08-31T00:27:01.741325+0000","last_clean":"2023-08-31T00:27:01.741325+0000","last_became_active":"2023-08-31T00:27:00.314924+0000","last_became_peered":"2023-08-31T00:27:00.314924+0000","last_unstale":"2023-08-31T00:27:01.741325+0000","last_undegraded":"2023-08-31T00:27:01.741325+0000","last_fullsized":"2023-08-31T00:27:01.741325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:35.008667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126669+0000","last_change":"2023-08-31T00:26:59.322925+0000","last_active":"2023-08-31T00:27:01.126669+0000","last_peered":"2023-08-31T00:27:01.126669+0000","last_clean":"2023-08-31T00:27:01.126669+0000","last_became_active":"2023-08-31T00:26:59.322585+0000","last_became_peered":"2023-08-31T00:26:59.322585+0000","last_unstale":"2023-08-31T00:27:01.126669+0000","last_undegraded":"2023-08-31T00:27:01.126669+0000","last_fullsized":"2023-08-31T00:27:01.126669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:09:38.012861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301815+0000","last_change":"2023-08-31T00:27:00.312503+0000","last_active":"2023-08-31T00:27:01.301815+0000","last_peered":"2023-08-31T00:27:01.301815+0000","last_clean":"2023-08-31T00:27:01.301815+0000","last_became_active":"2023-08-31T00:27:00.312047+0000","last_became_peered":"2023-08-31T00:27:00.312047+0000","last_unstale":"2023-08-31T00:27:01.301815+0000","last_undegraded":"2023-08-31T00:27:01.301815+0000","last_fullsized":"2023-08-31T00:27:01.301815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:12.300268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132250+0000","last_change":"2023-08-31T00:26:59.317022+0000","last_active":"2023-08-31T00:27:01.132250+0000","last_peered":"2023-08-31T00:27:01.132250+0000","last_clean":"2023-08-31T00:27:01.132250+0000","last_became_active":"2023-08-31T00:26:59.316703+0000","last_became_peered":"2023-08-31T00:26:59.316703+0000","last_unstale":"2023-08-31T00:27:01.132250+0000","last_undegraded":"2023-08-31T00:27:01.132250+0000","last_fullsized":"2023-08-31T00:27:01.132250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:12:59.364188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740454+0000","last_change":"2023-08-31T00:27:00.317829+0000","last_active":"2023-08-31T00:27:01.740454+0000","last_peered":"2023-08-31T00:27:01.740454+0000","last_clean":"2023-08-31T00:27:01.740454+0000","last_became_active":"2023-08-31T00:27:00.317552+0000","last_became_peered":"2023-08-31T00:27:00.317552+0000","last_unstale":"2023-08-31T00:27:01.740454+0000","last_undegraded":"2023-08-31T00:27:01.740454+0000","last_fullsized":"2023-08-31T00:27:01.740454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:26:14.695708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132269+0000","last_change":"2023-08-31T00:26:59.310991+0000","last_active":"2023-08-31T00:27:01.132269+0000","last_peered":"2023-08-31T00:27:01.132269+0000","last_clean":"2023-08-31T00:27:01.132269+0000","last_became_active":"2023-08-31T00:26:59.310696+0000","last_became_peered":"2023-08-31T00:26:59.310696+0000","last_unstale":"2023-08-31T00:27:01.132269+0000","last_undegraded":"2023-08-31T00:27:01.132269+0000","last_fullsized":"2023-08-31T00:27:01.132269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:24:55.287271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740886+0000","last_change":"2023-08-31T00:27:00.329128+0000","last_active":"2023-08-31T00:27:01.740886+0000","last_peered":"2023-08-31T00:27:01.740886+0000","last_clean":"2023-08-31T00:27:01.740886+0000","last_became_active":"2023-08-31T00:27:00.328627+0000","last_became_peered":"2023-08-31T00:27:00.328627+0000","last_unstale":"2023-08-31T00:27:01.740886+0000","last_undegraded":"2023-08-31T00:27:01.740886+0000","last_fullsized":"2023-08-31T00:27:01.740886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:57:04.686107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.126795+0000","last_change":"2023-08-31T00:26:59.325883+0000","last_active":"2023-08-31T00:27:01.126795+0000","last_peered":"2023-08-31T00:27:01.126795+0000","last_clean":"2023-08-31T00:27:01.126795+0000","last_became_active":"2023-08-31T00:26:59.325639+0000","last_became_peered":"2023-08-31T00:26:59.325639+0000","last_unstale":"2023-08-31T00:27:01.126795+0000","last_undegraded":"2023-08-31T00:27:01.126795+0000","last_fullsized":"2023-08-31T00:27:01.126795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:33.999823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301766+0000","last_change":"2023-08-31T00:27:00.312122+0000","last_active":"2023-08-31T00:27:01.301766+0000","last_peered":"2023-08-31T00:27:01.301766+0000","last_clean":"2023-08-31T00:27:01.301766+0000","last_became_active":"2023-08-31T00:27:00.311829+0000","last_became_peered":"2023-08-31T00:27:00.311829+0000","last_unstale":"2023-08-31T00:27:01.301766+0000","last_undegraded":"2023-08-31T00:27:01.301766+0000","last_fullsized":"2023-08-31T00:27:01.301766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:41.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134459+0000","last_change":"2023-08-31T00:26:59.321055+0000","last_active":"2023-08-31T00:27:01.134459+0000","last_peered":"2023-08-31T00:27:01.134459+0000","last_clean":"2023-08-31T00:27:01.134459+0000","last_became_active":"2023-08-31T00:26:59.320790+0000","last_became_peered":"2023-08-31T00:26:59.320790+0000","last_unstale":"2023-08-31T00:27:01.134459+0000","last_undegraded":"2023-08-31T00:27:01.134459+0000","last_fullsized":"2023-08-31T00:27:01.134459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:06:11.291424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741535+0000","last_change":"2023-08-31T00:27:00.325496+0000","last_active":"2023-08-31T00:27:01.741535+0000","last_peered":"2023-08-31T00:27:01.741535+0000","last_clean":"2023-08-31T00:27:01.741535+0000","last_became_active":"2023-08-31T00:27:00.325207+0000","last_became_peered":"2023-08-31T00:27:00.325207+0000","last_unstale":"2023-08-31T00:27:01.741535+0000","last_undegraded":"2023-08-31T00:27:01.741535+0000","last_fullsized":"2023-08-31T00:27:01.741535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:23.480298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.132314+0000","last_change":"2023-08-31T00:26:59.311899+0000","last_active":"2023-08-31T00:27:01.132314+0000","last_peered":"2023-08-31T00:27:01.132314+0000","last_clean":"2023-08-31T00:27:01.132314+0000","last_became_active":"2023-08-31T00:26:59.311612+0000","last_became_peered":"2023-08-31T00:26:59.311612+0000","last_unstale":"2023-08-31T00:27:01.132314+0000","last_undegraded":"2023-08-31T00:27:01.132314+0000","last_fullsized":"2023-08-31T00:27:01.132314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:15:33.497057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741184+0000","last_change":"2023-08-31T00:27:00.334889+0000","last_active":"2023-08-31T00:27:01.741184+0000","last_peered":"2023-08-31T00:27:01.741184+0000","last_clean":"2023-08-31T00:27:01.741184+0000","last_became_active":"2023-08-31T00:27:00.334672+0000","last_became_peered":"2023-08-31T00:27:00.334672+0000","last_unstale":"2023-08-31T00:27:01.741184+0000","last_undegraded":"2023-08-31T00:27:01.741184+0000","last_fullsized":"2023-08-31T00:27:01.741184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:14:43.010670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.134477+0000","last_change":"2023-08-31T00:26:59.311633+0000","last_active":"2023-08-31T00:27:01.134477+0000","last_peered":"2023-08-31T00:27:01.134477+0000","last_clean":"2023-08-31T00:27:01.134477+0000","last_became_active":"2023-08-31T00:26:59.311354+0000","last_became_peered":"2023-08-31T00:26:59.311354+0000","last_unstale":"2023-08-31T00:27:01.134477+0000","last_undegraded":"2023-08-31T00:27:01.134477+0000","last_fullsized":"2023-08-31T00:27:01.134477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:58.279756+0000","last_clean_scrub_stamp":"2023-08-31T00:26:58.279756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:26:54.801236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740954+0000","last_change":"2023-08-31T00:27:00.318313+0000","last_active":"2023-08-31T00:27:01.740954+0000","last_peered":"2023-08-31T00:27:01.740954+0000","last_clean":"2023-08-31T00:27:01.740954+0000","last_became_active":"2023-08-31T00:27:00.318100+0000","last_became_peered":"2023-08-31T00:27:00.318100+0000","last_unstale":"2023-08-31T00:27:01.740954+0000","last_undegraded":"2023-08-31T00:27:01.740954+0000","last_fullsized":"2023-08-31T00:27:01.740954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:14:43.010670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.301382+0000","last_change":"2023-08-31T00:27:00.307564+0000","last_active":"2023-08-31T00:27:01.301382+0000","last_peered":"2023-08-31T00:27:01.301382+0000","last_clean":"2023-08-31T00:27:01.301382+0000","last_became_active":"2023-08-31T00:27:00.307264+0000","last_became_peered":"2023-08-31T00:27:00.307264+0000","last_unstale":"2023-08-31T00:27:01.301382+0000","last_undegraded":"2023-08-31T00:27:01.301382+0000","last_fullsized":"2023-08-31T00:27:01.301382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:18:43.972766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740103+0000","last_change":"2023-08-31T00:27:00.322552+0000","last_active":"2023-08-31T00:27:01.740103+0000","last_peered":"2023-08-31T00:27:01.740103+0000","last_clean":"2023-08-31T00:27:01.740103+0000","last_became_active":"2023-08-31T00:27:00.322254+0000","last_became_peered":"2023-08-31T00:27:00.322254+0000","last_unstale":"2023-08-31T00:27:01.740103+0000","last_undegraded":"2023-08-31T00:27:01.740103+0000","last_fullsized":"2023-08-31T00:27:01.740103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:18:09.218490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741661+0000","last_change":"2023-08-31T00:27:00.334929+0000","last_active":"2023-08-31T00:27:01.741661+0000","last_peered":"2023-08-31T00:27:01.741661+0000","last_clean":"2023-08-31T00:27:01.741661+0000","last_became_active":"2023-08-31T00:27:00.334671+0000","last_became_peered":"2023-08-31T00:27:00.334671+0000","last_unstale":"2023-08-31T00:27:01.741661+0000","last_undegraded":"2023-08-31T00:27:01.741661+0000","last_fullsized":"2023-08-31T00:27:01.741661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:26:23.480298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741215+0000","last_change":"2023-08-31T00:27:00.327878+0000","last_active":"2023-08-31T00:27:01.741215+0000","last_peered":"2023-08-31T00:27:01.741215+0000","last_clean":"2023-08-31T00:27:01.741215+0000","last_became_active":"2023-08-31T00:27:00.327570+0000","last_became_peered":"2023-08-31T00:27:00.327570+0000","last_unstale":"2023-08-31T00:27:01.741215+0000","last_undegraded":"2023-08-31T00:27:01.741215+0000","last_fullsized":"2023-08-31T00:27:01.741215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740692+0000","last_change":"2023-08-31T00:27:00.321837+0000","last_active":"2023-08-31T00:27:01.740692+0000","last_peered":"2023-08-31T00:27:01.740692+0000","last_clean":"2023-08-31T00:27:01.740692+0000","last_became_active":"2023-08-31T00:27:00.321561+0000","last_became_peered":"2023-08-31T00:27:00.321561+0000","last_unstale":"2023-08-31T00:27:01.740692+0000","last_undegraded":"2023-08-31T00:27:01.740692+0000","last_fullsized":"2023-08-31T00:27:01.740692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.299955+0000","last_change":"2023-08-31T00:27:00.322796+0000","last_active":"2023-08-31T00:27:01.299955+0000","last_peered":"2023-08-31T00:27:01.299955+0000","last_clean":"2023-08-31T00:27:01.299955+0000","last_became_active":"2023-08-31T00:27:00.322507+0000","last_became_peered":"2023-08-31T00:27:00.322507+0000","last_unstale":"2023-08-31T00:27:01.299955+0000","last_undegraded":"2023-08-31T00:27:01.299955+0000","last_fullsized":"2023-08-31T00:27:01.299955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:37:35.008667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302863+0000","last_change":"2023-08-31T00:27:00.311231+0000","last_active":"2023-08-31T00:27:01.302863+0000","last_peered":"2023-08-31T00:27:01.302863+0000","last_clean":"2023-08-31T00:27:01.302863+0000","last_became_active":"2023-08-31T00:27:00.310948+0000","last_became_peered":"2023-08-31T00:27:00.310948+0000","last_unstale":"2023-08-31T00:27:01.302863+0000","last_undegraded":"2023-08-31T00:27:01.302863+0000","last_fullsized":"2023-08-31T00:27:01.302863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:03:09.285796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740870+0000","last_change":"2023-08-31T00:27:00.321793+0000","last_active":"2023-08-31T00:27:01.740870+0000","last_peered":"2023-08-31T00:27:01.740870+0000","last_clean":"2023-08-31T00:27:01.740870+0000","last_became_active":"2023-08-31T00:27:00.321498+0000","last_became_peered":"2023-08-31T00:27:00.321498+0000","last_unstale":"2023-08-31T00:27:01.740870+0000","last_undegraded":"2023-08-31T00:27:01.740870+0000","last_fullsized":"2023-08-31T00:27:01.740870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:01:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740530+0000","last_change":"2023-08-31T00:27:00.327048+0000","last_active":"2023-08-31T00:27:01.740530+0000","last_peered":"2023-08-31T00:27:01.740530+0000","last_clean":"2023-08-31T00:27:01.740530+0000","last_became_active":"2023-08-31T00:27:00.326522+0000","last_became_peered":"2023-08-31T00:27:00.326522+0000","last_unstale":"2023-08-31T00:27:01.740530+0000","last_undegraded":"2023-08-31T00:27:01.740530+0000","last_fullsized":"2023-08-31T00:27:01.740530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:22:25.021337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740619+0000","last_change":"2023-08-31T00:27:00.322224+0000","last_active":"2023-08-31T00:27:01.740619+0000","last_peered":"2023-08-31T00:27:01.740619+0000","last_clean":"2023-08-31T00:27:01.740619+0000","last_became_active":"2023-08-31T00:27:00.321978+0000","last_became_peered":"2023-08-31T00:27:00.321978+0000","last_unstale":"2023-08-31T00:27:01.740619+0000","last_undegraded":"2023-08-31T00:27:01.740619+0000","last_fullsized":"2023-08-31T00:27:01.740619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:35:16.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.740492+0000","last_change":"2023-08-31T00:27:00.327229+0000","last_active":"2023-08-31T00:27:01.740492+0000","last_peered":"2023-08-31T00:27:01.740492+0000","last_clean":"2023-08-31T00:27:01.740492+0000","last_became_active":"2023-08-31T00:27:00.326932+0000","last_became_peered":"2023-08-31T00:27:00.326932+0000","last_unstale":"2023-08-31T00:27:01.740492+0000","last_undegraded":"2023-08-31T00:27:01.740492+0000","last_fullsized":"2023-08-31T00:27:01.740492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:01:13.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.741105+0000","last_change":"2023-08-31T00:27:00.313686+0000","last_active":"2023-08-31T00:27:01.741105+0000","last_peered":"2023-08-31T00:27:01.741105+0000","last_clean":"2023-08-31T00:27:01.741105+0000","last_became_active":"2023-08-31T00:27:00.313386+0000","last_became_peered":"2023-08-31T00:27:00.313386+0000","last_unstale":"2023-08-31T00:27:01.741105+0000","last_undegraded":"2023-08-31T00:27:01.741105+0000","last_fullsized":"2023-08-31T00:27:01.741105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:12:41.180455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T00:27:01.302176+0000","last_change":"2023-08-31T00:27:00.316315+0000","last_active":"2023-08-31T00:27:01.302176+0000","last_peered":"2023-08-31T00:27:01.302176+0000","last_clean":"2023-08-31T00:27:01.302176+0000","last_became_active":"2023-08-31T00:27:00.313982+0000","last_became_peered":"2023-08-31T00:27:00.313982+0000","last_unstale":"2023-08-31T00:27:01.302176+0000","last_undegraded":"2023-08-31T00:27:01.302176+0000","last_fullsized":"2023-08-31T00:27:01.302176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:59.288600+0000","last_clean_scrub_stamp":"2023-08-31T00:26:59.288600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:21:15.452729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:27:09.818 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T00:27:09.818 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-31T00:27:09.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-31T00:27:09.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-31T00:27:09.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.972+0000 7f3faf6df700 1 -- 172.21.15.77:0/913731549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa81580f0 msgr2=0x7f3fa80cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.972+0000 7f3faf6df700 1 --2- 172.21.15.77:0/913731549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa81580f0 0x7f3fa80cc250 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80adaf0 tx=0x7f3f98009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:09.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.972+0000 7f3faf6df700 1 -- 172.21.15.77:0/913731549 shutdown_connections 2023-08-31T00:27:09.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.972+0000 7f3faf6df700 1 --2- 172.21.15.77:0/913731549 >> v2:172.21.15.139:3300/0 conn(0x7f3fa80711d0 0x7f3fa80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.972+0000 7f3faf6df700 1 --2- 172.21.15.77:0/913731549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa81580f0 0x7f3fa80cc250 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.972+0000 7f3faf6df700 1 -- 172.21.15.77:0/913731549 >> 172.21.15.77:0/913731549 conn(0x7f3fa806cbf0 msgr2=0x7f3fa806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:09.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.973+0000 7f3faf6df700 1 -- 172.21.15.77:0/913731549 shutdown_connections 2023-08-31T00:27:09.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.973+0000 7f3faf6df700 1 -- 172.21.15.77:0/913731549 wait complete. 2023-08-31T00:27:09.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 Processor -- start 2023-08-31T00:27:09.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 -- start start 2023-08-31T00:27:09.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fa806f130 0x7f3fa80c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 0x7f3fa80ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa81580f0 0x7f3fa8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa80c7800 con 0x7f3fa80711d0 2023-08-31T00:27:09.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa80ab790 con 0x7f3fa81580f0 2023-08-31T00:27:09.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3faf6df700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa80ac590 con 0x7f3fa806f130 2023-08-31T00:27:09.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.974+0000 7f3facc7a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 0x7f3fa80ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 0x7f3fa80ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38916/0 (socket says 172.21.15.77:38916) 2023-08-31T00:27:09.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 -- 172.21.15.77:0/2215210264 learned_addr learned my addr 172.21.15.77:0/2215210264 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:09.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 -- 172.21.15.77:0/2215210264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fa806f130 msgr2=0x7f3fa80c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fa806f130 0x7f3fa80c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 -- 172.21.15.77:0/2215210264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa81580f0 msgr2=0x7f3fa8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:09.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa81580f0 0x7f3fa8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 -- 172.21.15.77:0/2215210264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980095f0 con 0x7f3fa80711d0 2023-08-31T00:27:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3facc7a700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 0x7f3fa80ab250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c4d0 tx=0x7f3fa400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011790 con 0x7f3fa80711d0 2023-08-31T00:27:09.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3fa40119e0 con 0x7f3fa80711d0 2023-08-31T00:27:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa80aca20 con 0x7f3fa80711d0 2023-08-31T00:27:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011df0 con 0x7f3fa80711d0 2023-08-31T00:27:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.975+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa80abc60 con 0x7f3fa80711d0 2023-08-31T00:27:09.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.976+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa80668d0 con 0x7f3fa80711d0 2023-08-31T00:27:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.977+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3fa401c460 con 0x7f3fa80711d0 2023-08-31T00:27:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.977+0000 7f3f9dffb700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f8c06a0e0 0x7f3f8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:09.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.977+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fa40884d0 con 0x7f3fa80711d0 2023-08-31T00:27:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.977+0000 7f3fad47b700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f8c06a0e0 0x7f3f8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:09.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.977+0000 7f3fad47b700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f8c06a0e0 0x7f3f8c06c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f980098e0 tx=0x7f3f98004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:09.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:09.981+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3fa4053cb0 con 0x7f3fa80711d0 2023-08-31T00:27:10.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.211+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3fa80ac720 con 0x7f3fa80711d0 2023-08-31T00:27:10.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.212+0000 7f3f9dffb700 1 -- 172.21.15.77:0/2215210264 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3fa40572d0 con 0x7f3fa80711d0 2023-08-31T00:27:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:10.213 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-31T00:27:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f8c06a0e0 msgr2=0x7f3f8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f8c06a0e0 0x7f3f8c06c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f980098e0 tx=0x7f3f98004750 comp rx=0 tx=0).stop 2023-08-31T00:27:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 msgr2=0x7f3fa80ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 0x7f3fa80ab250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c4d0 tx=0x7f3fa400c890 comp rx=0 tx=0).stop 2023-08-31T00:27:10.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 shutdown_connections 2023-08-31T00:27:10.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3f8c06a0e0 0x7f3f8c06c5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fa806f130 0x7f3fa80c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fa81580f0 0x7f3fa8158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 --2- 172.21.15.77:0/2215210264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3fa80711d0 0x7f3fa80ab250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 >> 172.21.15.77:0/2215210264 conn(0x7f3fa806cbf0 msgr2=0x7f3fa81547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:10.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 shutdown_connections 2023-08-31T00:27:10.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.214+0000 7f3faf6df700 1 -- 172.21.15.77:0/2215210264 wait complete. 2023-08-31T00:27:10.227 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-31T00:27:10.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 -- 172.21.15.77:0/3524254216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 msgr2=0x7f825c0ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 --2- 172.21.15.77:0/3524254216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ce2b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f824c005fd0 tx=0x7f824c009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 -- 172.21.15.77:0/3524254216 shutdown_connections 2023-08-31T00:27:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 --2- 172.21.15.77:0/3524254216 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f825c15b3d0 0x7f825c0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 --2- 172.21.15.77:0/3524254216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ce2b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 -- 172.21.15.77:0/3524254216 >> 172.21.15.77:0/3524254216 conn(0x7f825c071630 msgr2=0x7f825c071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:10.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 -- 172.21.15.77:0/3524254216 shutdown_connections 2023-08-31T00:27:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.351+0000 7f82614d3700 1 -- 172.21.15.77:0/3524254216 wait complete. 2023-08-31T00:27:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.353+0000 7f82614d3700 1 Processor -- start 2023-08-31T00:27:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.353+0000 7f82614d3700 1 -- start start 2023-08-31T00:27:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f82614d3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f82614d3700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f825c0ce7f0 0x7f825c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f82614d3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c15b3d0 0x7f825c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f82614d3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0caef0 con 0x7f825c0b04a0 2023-08-31T00:27:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f82614d3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c5080 con 0x7f825c15b3d0 2023-08-31T00:27:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f82614d3700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0c5320 con 0x7f825c0ce7f0 2023-08-31T00:27:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38930/0 (socket says 172.21.15.77:38930) 2023-08-31T00:27:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 -- 172.21.15.77:0/2302606071 learned_addr learned my addr 172.21.15.77:0/2302606071 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825a7fc700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f825c0ce7f0 0x7f825c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 -- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f825c0ce7f0 msgr2=0x7f825c0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825b7fe700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c15b3d0 0x7f825c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f825c0ce7f0 0x7f825c0c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 -- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c15b3d0 msgr2=0x7f825c0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c15b3d0 0x7f825c0c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.354+0000 7f825affd700 1 -- 172.21.15.77:0/2302606071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0095f0 con 0x7f825c0b04a0 2023-08-31T00:27:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.355+0000 7f825affd700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ca9b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f825000c970 tx=0x7f825000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.355+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250007b00 con 0x7f825c0b04a0 2023-08-31T00:27:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.355+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8250007c60 con 0x7f825c0b04a0 2023-08-31T00:27:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.355+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0c5600 con 0x7f825c0b04a0 2023-08-31T00:27:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.355+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250004a90 con 0x7f825c0b04a0 2023-08-31T00:27:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.355+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0c5bc0 con 0x7f825c0b04a0 2023-08-31T00:27:10.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.356+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c0b3170 con 0x7f825c0b04a0 2023-08-31T00:27:10.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.356+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8250004bf0 con 0x7f825c0b04a0 2023-08-31T00:27:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.357+0000 7f82437fe700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f824806a0e0 0x7f824806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.357+0000 7f825a7fc700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f824806a0e0 0x7f824806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.357+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8250088b90 con 0x7f825c0b04a0 2023-08-31T00:27:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.357+0000 7f825a7fc700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f824806a0e0 0x7f824806c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f825c0c7950 tx=0x7f824c0047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:10.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.360+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8250054450 con 0x7f825c0b04a0 2023-08-31T00:27:10.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.552+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825c073c30 con 0x7f825c0b04a0 2023-08-31T00:27:10.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.553+0000 7f82437fe700 1 -- 172.21.15.77:0/2302606071 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f825001d020 con 0x7f825c0b04a0 2023-08-31T00:27:10.554 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:10.554 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:10.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f824806a0e0 msgr2=0x7f824806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f824806a0e0 0x7f824806c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f825c0c7950 tx=0x7f824c0047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 msgr2=0x7f825c0ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ca9b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f825000c970 tx=0x7f825000cd30 comp rx=0 tx=0).stop 2023-08-31T00:27:10.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 shutdown_connections 2023-08-31T00:27:10.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f824806a0e0 0x7f824806c5a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f825c15b3d0 0x7f825c0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f825c0b04a0 0x7f825c0ca9b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 --2- 172.21.15.77:0/2302606071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f825c0ce7f0 0x7f825c0c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 >> 172.21.15.77:0/2302606071 conn(0x7f825c071630 msgr2=0x7f825c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:10.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 shutdown_connections 2023-08-31T00:27:10.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.555+0000 7f82614d3700 1 -- 172.21.15.77:0/2302606071 wait complete. 2023-08-31T00:27:10.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:10.569 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:10.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f39b46700 1 -- 172.21.15.77:0/3396574470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f200043e0 msgr2=0x7f1f200048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f39b46700 1 --2- 172.21.15.77:0/3396574470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f200043e0 0x7f1f200048b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00c2e0 tx=0x7f1f20005880 comp rx=0 tx=0).stop 2023-08-31T00:27:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f33fff700 1 -- 172.21.15.77:0/3396574470 reap_dead start 2023-08-31T00:27:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f39b46700 1 -- 172.21.15.77:0/3396574470 shutdown_connections 2023-08-31T00:27:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f39b46700 1 -- 172.21.15.77:0/3396574470 >> 172.21.15.77:0/3396574470 conn(0x7f1f340afbf0 msgr2=0x7f1f340b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f39b46700 1 -- 172.21.15.77:0/3396574470 shutdown_connections 2023-08-31T00:27:10.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.694+0000 7f1f39b46700 1 -- 172.21.15.77:0/3396574470 wait complete. 2023-08-31T00:27:10.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.696+0000 7f1f39b46700 1 Processor -- start 2023-08-31T00:27:10.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.696+0000 7f1f39b46700 1 -- start start 2023-08-31T00:27:10.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f39b46700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f200043e0 0x7f1f34154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f39b46700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f341520b0 0x7f1f340b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f39b46700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 0x7f1f340b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f39b46700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340b09d0 con 0x7f1f340b0000 2023-08-31T00:27:10.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f39b46700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340c6740 con 0x7f1f200043e0 2023-08-31T00:27:10.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f39b46700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340b2c80 con 0x7f1f341520b0 2023-08-31T00:27:10.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 0x7f1f340b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 0x7f1f340b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38954/0 (socket says 172.21.15.77:38954) 2023-08-31T00:27:10.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 -- 172.21.15.77:0/1067209726 learned_addr learned my addr 172.21.15.77:0/1067209726 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:10.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f337fe700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f200043e0 0x7f1f34154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f32ffd700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f341520b0 0x7f1f340b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 -- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f341520b0 msgr2=0x7f1f340b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f341520b0 0x7f1f340b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 -- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f200043e0 msgr2=0x7f1f34154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f200043e0 0x7f1f34154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f33fff700 1 -- 172.21.15.77:0/1067209726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340c83f0 con 0x7f1f340b0000 2023-08-31T00:27:10.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f32ffd700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f341520b0 0x7f1f340b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:10.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.697+0000 7f1f337fe700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f200043e0 0x7f1f34154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:10.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.698+0000 7f1f33fff700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 0x7f1f340b0490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1f340c8720 tx=0x7f1f2c006620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:10.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.698+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c011900 con 0x7f1f340b0000 2023-08-31T00:27:10.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.698+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1f2c011aa0 con 0x7f1f340b0000 2023-08-31T00:27:10.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.698+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f340b2e90 con 0x7f1f340b0000 2023-08-31T00:27:10.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.698+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c0103c0 con 0x7f1f340b0000 2023-08-31T00:27:10.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.698+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f340c4600 con 0x7f1f340b0000 2023-08-31T00:27:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.699+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f34073c30 con 0x7f1f340b0000 2023-08-31T00:27:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.699+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f2c010520 con 0x7f1f340b0000 2023-08-31T00:27:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.699+0000 7f1f2bfff700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1f1406a0e0 0x7f1f1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.700+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f2c0893b0 con 0x7f1f340b0000 2023-08-31T00:27:10.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.700+0000 7f1f337fe700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1f1406a0e0 0x7f1f1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:10.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.700+0000 7f1f337fe700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1f1406a0e0 0x7f1f1406c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009cc0 tx=0x7f1f24009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:10.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.704+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1f2c054c20 con 0x7f1f340b0000 2023-08-31T00:27:10.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.893+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f340cb930 con 0x7f1f340b0000 2023-08-31T00:27:10.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.894+0000 7f1f2bfff700 1 -- 172.21.15.77:0/1067209726 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f2c01f0a0 con 0x7f1f340b0000 2023-08-31T00:27:10.895 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:10.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1f1406a0e0 msgr2=0x7f1f1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1f1406a0e0 0x7f1f1406c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009cc0 tx=0x7f1f24009260 comp rx=0 tx=0).stop 2023-08-31T00:27:10.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 msgr2=0x7f1f340b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:10.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 0x7f1f340b0490 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1f340c8720 tx=0x7f1f2c006620 comp rx=0 tx=0).stop 2023-08-31T00:27:10.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 shutdown_connections 2023-08-31T00:27:10.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1f1406a0e0 0x7f1f1406c5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1f340b0000 0x7f1f340b0490 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f200043e0 0x7f1f34154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 --2- 172.21.15.77:0/1067209726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1f341520b0 0x7f1f340b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:10.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 >> 172.21.15.77:0/1067209726 conn(0x7f1f340afbf0 msgr2=0x7f1f340cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:10.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 shutdown_connections 2023-08-31T00:27:10.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:10.896+0000 7f1f39b46700 1 -- 172.21.15.77:0/1067209726 wait complete. 2023-08-31T00:27:10.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:11.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 -- 172.21.15.77:0/3697244774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c0711d0 msgr2=0x7fe20c162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 --2- 172.21.15.77:0/3697244774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c0711d0 0x7fe20c162ec0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe204009f60 tx=0x7fe204009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:11.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 -- 172.21.15.77:0/3697244774 shutdown_connections 2023-08-31T00:27:11.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 --2- 172.21.15.77:0/3697244774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c0711d0 0x7fe20c162ec0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 -- 172.21.15.77:0/3697244774 >> 172.21.15.77:0/3697244774 conn(0x7fe20c06cbf0 msgr2=0x7fe20c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:11.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 -- 172.21.15.77:0/3697244774 shutdown_connections 2023-08-31T00:27:11.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.034+0000 7fe214208700 1 -- 172.21.15.77:0/3697244774 wait complete. 2023-08-31T00:27:11.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.035+0000 7fe214208700 1 Processor -- start 2023-08-31T00:27:11.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.035+0000 7fe214208700 1 -- start start 2023-08-31T00:27:11.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe214208700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe20c06f130 0x7fe20c14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe214208700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 0x7fe20c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe214208700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c1580f0 0x7fe20c14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe214208700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c14c230 con 0x7fe20c0711d0 2023-08-31T00:27:11.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe214208700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c14b1c0 con 0x7fe20c1580f0 2023-08-31T00:27:11.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe214208700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c14e8e0 con 0x7fe20c06f130 2023-08-31T00:27:11.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2117a3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 0x7fe20c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2117a3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 0x7fe20c14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38966/0 (socket says 172.21.15.77:38966) 2023-08-31T00:27:11.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2117a3700 1 -- 172.21.15.77:0/1438280445 learned_addr learned my addr 172.21.15.77:0/1438280445 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:11.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2127a5700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c1580f0 0x7fe20c14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe211fa4700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe20c06f130 0x7fe20c14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2117a3700 1 -- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe20c06f130 msgr2=0x7fe20c14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2117a3700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe20c06f130 0x7fe20c14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.036+0000 7fe2117a3700 1 -- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c1580f0 msgr2=0x7fe20c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2117a3700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c1580f0 0x7fe20c14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2117a3700 1 -- 172.21.15.77:0/1438280445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009c40 con 0x7fe20c0711d0 2023-08-31T00:27:11.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2127a5700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c1580f0 0x7fe20c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:11.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2117a3700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 0x7fe20c14e2b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c490 tx=0x7fe1fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:11.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0052d0 con 0x7fe20c0711d0 2023-08-31T00:27:11.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1fc005540 con 0x7fe20c0711d0 2023-08-31T00:27:11.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc006aa0 con 0x7fe20c0711d0 2023-08-31T00:27:11.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c15fec0 con 0x7fe20c0711d0 2023-08-31T00:27:11.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.037+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c14ee10 con 0x7fe20c0711d0 2023-08-31T00:27:11.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.038+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c14c370 con 0x7fe20c0711d0 2023-08-31T00:27:11.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.038+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1fc003680 con 0x7fe20c0711d0 2023-08-31T00:27:11.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.039+0000 7fe2027fc700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe1f006a0e0 0x7fe1f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.039+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1fc0879a0 con 0x7fe20c0711d0 2023-08-31T00:27:11.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.039+0000 7fe211fa4700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe1f006a0e0 0x7fe1f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.039+0000 7fe211fa4700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe1f006a0e0 0x7fe1f006c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe208007880 tx=0x7fe208009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:11.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.043+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe20c14c370 con 0x7fe20c0711d0 2023-08-31T00:27:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.235+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe20c14c370 con 0x7fe20c0711d0 2023-08-31T00:27:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.235+0000 7fe2027fc700 1 -- 172.21.15.77:0/1438280445 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe20c14c370 con 0x7fe20c0711d0 2023-08-31T00:27:11.237 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe1f006a0e0 msgr2=0x7fe1f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe1f006a0e0 0x7fe1f006c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe208007880 tx=0x7fe208009040 comp rx=0 tx=0).stop 2023-08-31T00:27:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 msgr2=0x7fe20c14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 0x7fe20c14e2b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c490 tx=0x7fe1fc00c850 comp rx=0 tx=0).stop 2023-08-31T00:27:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 shutdown_connections 2023-08-31T00:27:11.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe1f006a0e0 0x7fe1f006c5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe20c06f130 0x7fe20c14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe20c1580f0 0x7fe20c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 --2- 172.21.15.77:0/1438280445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe20c0711d0 0x7fe20c14e2b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 >> 172.21.15.77:0/1438280445 conn(0x7fe20c06cbf0 msgr2=0x7fe20c159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 shutdown_connections 2023-08-31T00:27:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.238+0000 7fe214208700 1 -- 172.21.15.77:0/1438280445 wait complete. 2023-08-31T00:27:11.251 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 -- 172.21.15.77:0/627681051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2006f130 msgr2=0x7f0e20070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 --2- 172.21.15.77:0/627681051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2006f130 0x7f0e20070ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098c0 tx=0x7f0e10009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 -- 172.21.15.77:0/627681051 shutdown_connections 2023-08-31T00:27:11.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 --2- 172.21.15.77:0/627681051 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e20071000 0x7f0e200c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 --2- 172.21.15.77:0/627681051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2006f130 0x7f0e20070ac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 -- 172.21.15.77:0/627681051 >> 172.21.15.77:0/627681051 conn(0x7f0e2006cbf0 msgr2=0x7f0e2006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:11.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 -- 172.21.15.77:0/627681051 shutdown_connections 2023-08-31T00:27:11.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.375+0000 7f0e26644700 1 -- 172.21.15.77:0/627681051 wait complete. 2023-08-31T00:27:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.377+0000 7f0e26644700 1 Processor -- start 2023-08-31T00:27:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.377+0000 7f0e26644700 1 -- start start 2023-08-31T00:27:11.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e26644700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e2006f130 0x7f0e201547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e26644700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e20071000 0x7f0e201e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e26644700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 0x7f0e200c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e26644700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200c74c0 con 0x7f0e201580f0 2023-08-31T00:27:11.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e26644700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200c6b90 con 0x7f0e2006f130 2023-08-31T00:27:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e26644700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200c6e70 con 0x7f0e20071000 2023-08-31T00:27:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 0x7f0e200c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 0x7f0e200c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38982/0 (socket says 172.21.15.77:38982) 2023-08-31T00:27:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 -- 172.21.15.77:0/950244885 learned_addr learned my addr 172.21.15.77:0/950244885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e1f7fe700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e20071000 0x7f0e201e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e1ffff700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e2006f130 0x7f0e201547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 -- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e20071000 msgr2=0x7f0e201e21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e20071000 0x7f0e201e21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 -- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e2006f130 msgr2=0x7f0e201547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e2006f130 0x7f0e201547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.378+0000 7f0e24be1700 1 -- 172.21.15.77:0/950244885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009520 con 0x7f0e201580f0 2023-08-31T00:27:11.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.379+0000 7f0e24be1700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 0x7f0e200c3fc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800cfb0 tx=0x7f0e1800e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:11.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.379+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18011070 con 0x7f0e201580f0 2023-08-31T00:27:11.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.379+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e1800c2e0 con 0x7f0e201580f0 2023-08-31T00:27:11.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.379+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e200c7150 con 0x7f0e201580f0 2023-08-31T00:27:11.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.379+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800eca0 con 0x7f0e201580f0 2023-08-31T00:27:11.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.379+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e20154d10 con 0x7f0e201580f0 2023-08-31T00:27:11.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.380+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e20154f00 con 0x7f0e201580f0 2023-08-31T00:27:11.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.380+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e1800a600 con 0x7f0e201580f0 2023-08-31T00:27:11.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.381+0000 7f0e1cff9700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e0006a0e0 0x7f0e0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.381+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e1808a6a0 con 0x7f0e201580f0 2023-08-31T00:27:11.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.381+0000 7f0e1ffff700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e0006a0e0 0x7f0e0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.381+0000 7f0e1ffff700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e0006a0e0 0x7f0e0006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007fd0 tx=0x7f0e08009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:11.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.385+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0e18055de0 con 0x7f0e201580f0 2023-08-31T00:27:11.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.576+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e20073c30 con 0x7f0e201580f0 2023-08-31T00:27:11.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.576+0000 7f0e1cff9700 1 -- 172.21.15.77:0/950244885 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e18010130 con 0x7f0e201580f0 2023-08-31T00:27:11.578 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:11.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e0006a0e0 msgr2=0x7f0e0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e0006a0e0 0x7f0e0006c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007fd0 tx=0x7f0e08009040 comp rx=0 tx=0).stop 2023-08-31T00:27:11.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 msgr2=0x7f0e200c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 0x7f0e200c3fc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800cfb0 tx=0x7f0e1800e330 comp rx=0 tx=0).stop 2023-08-31T00:27:11.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 shutdown_connections 2023-08-31T00:27:11.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e0006a0e0 0x7f0e0006c5a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201580f0 0x7f0e200c3fc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e2006f130 0x7f0e201547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 --2- 172.21.15.77:0/950244885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e20071000 0x7f0e201e21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.578+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 >> 172.21.15.77:0/950244885 conn(0x7f0e2006cbf0 msgr2=0x7f0e20158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.579+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 shutdown_connections 2023-08-31T00:27:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.579+0000 7f0e26644700 1 -- 172.21.15.77:0/950244885 wait complete. 2023-08-31T00:27:11.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:11.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 -- 172.21.15.77:0/202726168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a801580f0 msgr2=0x7f1a800cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 --2- 172.21.15.77:0/202726168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a801580f0 0x7f1a800cc250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1a800c1750 tx=0x7f1a74009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 -- 172.21.15.77:0/202726168 shutdown_connections 2023-08-31T00:27:11.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 --2- 172.21.15.77:0/202726168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a801580f0 0x7f1a800cc250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 --2- 172.21.15.77:0/202726168 >> v2:172.21.15.139:3300/0 conn(0x7f1a8006f130 0x7f1a80070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 -- 172.21.15.77:0/202726168 >> 172.21.15.77:0/202726168 conn(0x7f1a8006cbf0 msgr2=0x7f1a8006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:11.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 -- 172.21.15.77:0/202726168 shutdown_connections 2023-08-31T00:27:11.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.713+0000 7f1a850d1700 1 -- 172.21.15.77:0/202726168 wait complete. 2023-08-31T00:27:11.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.715+0000 7f1a850d1700 1 Processor -- start 2023-08-31T00:27:11.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.715+0000 7f1a850d1700 1 -- start start 2023-08-31T00:27:11.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 0x7f1a8014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a80071000 0x7f1a801e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a801580f0 0x7f1a80069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801e3720 con 0x7f1a8006f130 2023-08-31T00:27:11.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801e2e80 con 0x7f1a80071000 2023-08-31T00:27:11.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801e3160 con 0x7f1a801580f0 2023-08-31T00:27:11.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 0x7f1a8014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 0x7f1a8014a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38992/0 (socket says 172.21.15.77:38992) 2023-08-31T00:27:11.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 -- 172.21.15.77:0/1526813252 learned_addr learned my addr 172.21.15.77:0/1526813252 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:11.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7f59e700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a801580f0 0x7f1a80069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7e59c700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a80071000 0x7f1a801e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 -- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a801580f0 msgr2=0x7f1a80069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a801580f0 0x7f1a80069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 -- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a80071000 msgr2=0x7f1a801e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a80071000 0x7f1a801e23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 -- 172.21.15.77:0/1526813252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009520 con 0x7f1a8006f130 2023-08-31T00:27:11.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a7ed9d700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 0x7f1a8014a410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009fa0 tx=0x7f1a740107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:11.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74004050 con 0x7f1a8006f130 2023-08-31T00:27:11.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1a740041b0 con 0x7f1a8006f130 2023-08-31T00:27:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a801e3440 con 0x7f1a8006f130 2023-08-31T00:27:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.716+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74004560 con 0x7f1a8006f130 2023-08-31T00:27:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.717+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8014a950 con 0x7f1a8006f130 2023-08-31T00:27:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.717+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a800c1b50 con 0x7f1a8006f130 2023-08-31T00:27:11.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.718+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a74003680 con 0x7f1a8006f130 2023-08-31T00:27:11.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.718+0000 7f1a677fe700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a6c06a0e0 0x7f1a6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:11.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.718+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a7408a0c0 con 0x7f1a8006f130 2023-08-31T00:27:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.718+0000 7f1a7e59c700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a6c06a0e0 0x7f1a6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.719+0000 7f1a7e59c700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a6c06a0e0 0x7f1a6c06c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fd0 tx=0x7f1a70005f60 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:11.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.722+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1a800c1b50 con 0x7f1a8006f130 2023-08-31T00:27:11.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.954+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a800c1b50 con 0x7f1a8006f130 2023-08-31T00:27:11.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.955+0000 7f1a677fe700 1 -- 172.21.15.77:0/1526813252 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f1a800c1b50 con 0x7f1a8006f130 2023-08-31T00:27:11.956 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:11.956 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:11.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a6c06a0e0 msgr2=0x7f1a6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a6c06a0e0 0x7f1a6c06c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a70005fd0 tx=0x7f1a70005f60 comp rx=0 tx=0).stop 2023-08-31T00:27:11.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 msgr2=0x7f1a8014a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:11.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 0x7f1a8014a410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009fa0 tx=0x7f1a740107d0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 shutdown_connections 2023-08-31T00:27:11.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a6c06a0e0 0x7f1a6c06c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1a801580f0 0x7f1a80069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a8006f130 0x7f1a8014a410 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 --2- 172.21.15.77:0/1526813252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a80071000 0x7f1a801e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:11.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 >> 172.21.15.77:0/1526813252 conn(0x7f1a8006cbf0 msgr2=0x7f1a80159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:11.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 shutdown_connections 2023-08-31T00:27:11.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:11.957+0000 7f1a850d1700 1 -- 172.21.15.77:0/1526813252 wait complete. 2023-08-31T00:27:11.960 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:11.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:12.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.091+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2074959295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c01580f0 msgr2=0x7fd1c00cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.091+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2074959295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c01580f0 0x7fd1c00cc250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00c1750 tx=0x7fd1b0009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2074959295 shutdown_connections 2023-08-31T00:27:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2074959295 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1c0071000 0x7fd1c015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2074959295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c01580f0 0x7fd1c00cc250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2074959295 >> v2:172.21.15.139:3300/0 conn(0x7fd1c006f130 0x7fd1c0070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2074959295 >> 172.21.15.77:0/2074959295 conn(0x7fd1c006cbf0 msgr2=0x7fd1c006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2074959295 shutdown_connections 2023-08-31T00:27:12.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.092+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2074959295 wait complete. 2023-08-31T00:27:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 Processor -- start 2023-08-31T00:27:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 -- start start 2023-08-31T00:27:12.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c006f130 0x7fd1c01e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 0x7fd1c01f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1c01580f0 0x7fd1c00c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c01e67f0 con 0x7fd1c0071000 2023-08-31T00:27:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00c6d30 con 0x7fd1c006f130 2023-08-31T00:27:12.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.093+0000 7fd1c77e2700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00c6140 con 0x7fd1c01580f0 2023-08-31T00:27:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 0x7fd1c01f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 0x7fd1c01f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39006/0 (socket says 172.21.15.77:39006) 2023-08-31T00:27:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 -- 172.21.15.77:0/2736576630 learned_addr learned my addr 172.21.15.77:0/2736576630 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c5d7f700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1c01580f0 0x7fd1c00c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c557e700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c006f130 0x7fd1c01e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 -- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1c01580f0 msgr2=0x7fd1c00c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1c01580f0 0x7fd1c00c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 -- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c006f130 msgr2=0x7fd1c01e62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c006f130 0x7fd1c01e62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 -- 172.21.15.77:0/2736576630 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b00095f0 con 0x7fd1c0071000 2023-08-31T00:27:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c557e700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c006f130 0x7fd1c01e62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c4d7d700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 0x7fd1c01f2df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00c920 tx=0x7fd1bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc007b00 con 0x7fd1c0071000 2023-08-31T00:27:12.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd1bc007d50 con 0x7fd1c0071000 2023-08-31T00:27:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c00c6400 con 0x7fd1c0071000 2023-08-31T00:27:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc004a90 con 0x7fd1c0071000 2023-08-31T00:27:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.094+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c00c69c0 con 0x7fd1c0071000 2023-08-31T00:27:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.095+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c00c6ee0 con 0x7fd1c0071000 2023-08-31T00:27:12.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.096+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd1bc004bf0 con 0x7fd1c0071000 2023-08-31T00:27:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.096+0000 7fd1b5ffb700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd1a406a0e0 0x7fd1a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.096+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1bc088810 con 0x7fd1c0071000 2023-08-31T00:27:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.096+0000 7fd1c557e700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd1a406a0e0 0x7fd1a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.096+0000 7fd1c557e700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd1a406a0e0 0x7fd1a406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00098e0 tx=0x7fd1b0011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:12.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.100+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd1c00c6ee0 con 0x7fd1c0071000 2023-08-31T00:27:12.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.297+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1c01585b0 con 0x7fd1c0071000 2023-08-31T00:27:12.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.298+0000 7fd1b5ffb700 1 -- 172.21.15.77:0/2736576630 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fd1bc053ff0 con 0x7fd1c0071000 2023-08-31T00:27:12.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:12.299 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:12.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.300+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd1a406a0e0 msgr2=0x7fd1a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.300+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd1a406a0e0 0x7fd1a406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00098e0 tx=0x7fd1b0011040 comp rx=0 tx=0).stop 2023-08-31T00:27:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.300+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 msgr2=0x7fd1c01f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.300+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 0x7fd1c01f2df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00c920 tx=0x7fd1bc00cce0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 shutdown_connections 2023-08-31T00:27:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd1a406a0e0 0x7fd1a406c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1c01580f0 0x7fd1c00c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1c006f130 0x7fd1c01e62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 --2- 172.21.15.77:0/2736576630 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1c0071000 0x7fd1c01f2df0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 >> 172.21.15.77:0/2736576630 conn(0x7fd1c006cbf0 msgr2=0x7fd1c0069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:12.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 shutdown_connections 2023-08-31T00:27:12.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.301+0000 7fd1c77e2700 1 -- 172.21.15.77:0/2736576630 wait complete. 2023-08-31T00:27:12.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:12.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:12.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 -- 172.21.15.77:0/1398740703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 msgr2=0x7fcd280cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1398740703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280cc250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd280adaf0 tx=0x7fcd18009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:12.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 -- 172.21.15.77:0/1398740703 shutdown_connections 2023-08-31T00:27:12.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1398740703 >> v2:172.21.15.139:3300/0 conn(0x7fcd280711d0 0x7fcd280c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1398740703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280cc250 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 -- 172.21.15.77:0/1398740703 >> 172.21.15.77:0/1398740703 conn(0x7fcd2806cbf0 msgr2=0x7fcd2806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:12.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 -- 172.21.15.77:0/1398740703 shutdown_connections 2023-08-31T00:27:12.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.438+0000 7fcd3007c700 1 -- 172.21.15.77:0/1398740703 wait complete. 2023-08-31T00:27:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.440+0000 7fcd3007c700 1 Processor -- start 2023-08-31T00:27:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.440+0000 7fcd3007c700 1 -- start start 2023-08-31T00:27:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd3007c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2806f130 0x7fcd281538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd3007c700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd280711d0 0x7fcd281f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd3007c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd3007c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28153de0 con 0x7fcd281580f0 2023-08-31T00:27:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd3007c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281f5d80 con 0x7fcd2806f130 2023-08-31T00:27:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd3007c700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280c6010 con 0x7fcd280711d0 2023-08-31T00:27:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39024/0 (socket says 172.21.15.77:39024) 2023-08-31T00:27:12.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 -- 172.21.15.77:0/1626019605 learned_addr learned my addr 172.21.15.77:0/1626019605 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:12.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2de18700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2806f130 0x7fcd281538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2d617700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd280711d0 0x7fcd281f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 -- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd280711d0 msgr2=0x7fcd281f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd280711d0 0x7fcd281f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 -- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2806f130 msgr2=0x7fcd281538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2806f130 0x7fcd281538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2e619700 1 -- 172.21.15.77:0/1626019605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd180095f0 con 0x7fcd281580f0 2023-08-31T00:27:12.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.441+0000 7fcd2d617700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd280711d0 0x7fcd281f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:12.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.442+0000 7fcd2e619700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280c5ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd200094f0 tx=0x7fcd2000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:12.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.442+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2000ddd0 con 0x7fcd281580f0 2023-08-31T00:27:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.442+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcd2000f040 con 0x7fcd281580f0 2023-08-31T00:27:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.442+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20004e10 con 0x7fcd281580f0 2023-08-31T00:27:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.442+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd280aac50 con 0x7fcd281580f0 2023-08-31T00:27:12.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.442+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd280ab210 con 0x7fcd281580f0 2023-08-31T00:27:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.443+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28073c30 con 0x7fcd281580f0 2023-08-31T00:27:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.443+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd20015400 con 0x7fcd281580f0 2023-08-31T00:27:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.443+0000 7fcd1e7fc700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcd0c06a0e0 0x7fcd0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.443+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd20088450 con 0x7fcd281580f0 2023-08-31T00:27:12.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.443+0000 7fcd2de18700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcd0c06a0e0 0x7fcd0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.444+0000 7fcd2de18700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcd0c06a0e0 0x7fcd0c06c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd18000c00 tx=0x7fcd18011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:12.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.448+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd20053c30 con 0x7fcd281580f0 2023-08-31T00:27:12.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.634+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd2815b110 con 0x7fcd281580f0 2023-08-31T00:27:12.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.635+0000 7fcd1e7fc700 1 -- 172.21.15.77:0/1626019605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd20057250 con 0x7fcd281580f0 2023-08-31T00:27:12.636 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:12.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcd0c06a0e0 msgr2=0x7fcd0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcd0c06a0e0 0x7fcd0c06c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcd18000c00 tx=0x7fcd18011040 comp rx=0 tx=0).stop 2023-08-31T00:27:12.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 msgr2=0x7fcd280c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280c5ad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd200094f0 tx=0x7fcd2000d3b0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 shutdown_connections 2023-08-31T00:27:12.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcd0c06a0e0 0x7fcd0c06c5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd281580f0 0x7fcd280c5ad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd2806f130 0x7fcd281538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 --2- 172.21.15.77:0/1626019605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd280711d0 0x7fcd281f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 >> 172.21.15.77:0/1626019605 conn(0x7fcd2806cbf0 msgr2=0x7fcd281545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:12.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 shutdown_connections 2023-08-31T00:27:12.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.637+0000 7fcd3007c700 1 -- 172.21.15.77:0/1626019605 wait complete. 2023-08-31T00:27:12.649 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 -- 172.21.15.77:0/687275859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd806f130 msgr2=0x7fedd8070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 --2- 172.21.15.77:0/687275859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd806f130 0x7fedd8070ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fedc80098c0 tx=0x7fedc8009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 -- 172.21.15.77:0/687275859 shutdown_connections 2023-08-31T00:27:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 --2- 172.21.15.77:0/687275859 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fedd8071000 0x7fedd80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 --2- 172.21.15.77:0/687275859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd806f130 0x7fedd8070ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 -- 172.21.15.77:0/687275859 >> 172.21.15.77:0/687275859 conn(0x7fedd806cbf0 msgr2=0x7fedd806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 -- 172.21.15.77:0/687275859 shutdown_connections 2023-08-31T00:27:12.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.773+0000 7fedddb6e700 1 -- 172.21.15.77:0/687275859 wait complete. 2023-08-31T00:27:12.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.774+0000 7fedddb6e700 1 Processor -- start 2023-08-31T00:27:12.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 -- start start 2023-08-31T00:27:12.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fedd806f130 0x7fedd813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fedd8071000 0x7fedd813e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 0x7fedd8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd813e4b0 con 0x7fedd81580f0 2023-08-31T00:27:12.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8144b50 con 0x7fedd806f130 2023-08-31T00:27:12.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedddb6e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81413e0 con 0x7fedd8071000 2023-08-31T00:27:12.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.775+0000 7fedd7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 0x7fedd8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 0x7fedd8157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39038/0 (socket says 172.21.15.77:39038) 2023-08-31T00:27:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 -- 172.21.15.77:0/4175997565 learned_addr learned my addr 172.21.15.77:0/4175997565 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 -- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fedd8071000 msgr2=0x7fedd813e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd6ffd700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fedd8071000 0x7fedd813e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fedd8071000 0x7fedd813e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 -- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fedd806f130 msgr2=0x7fedd813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fedd806f130 0x7fedd813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 -- 172.21.15.77:0/4175997565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8009520 con 0x7fedd81580f0 2023-08-31T00:27:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedd7fff700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 0x7fedd8157030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fedd0007ee0 tx=0x7fedd000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0017070 con 0x7fedd81580f0 2023-08-31T00:27:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fedd000f040 con 0x7fedd81580f0 2023-08-31T00:27:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd81416c0 con 0x7fedd81580f0 2023-08-31T00:27:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd000de10 con 0x7fedd81580f0 2023-08-31T00:27:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.776+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd8156830 con 0x7fedd81580f0 2023-08-31T00:27:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.777+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd81563b0 con 0x7fedd81580f0 2023-08-31T00:27:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.777+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedd001c410 con 0x7fedd81580f0 2023-08-31T00:27:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.778+0000 7fedbffff700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc406a0e0 0x7fedc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.778+0000 7fedd77fe700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc406a0e0 0x7fedc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.778+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedd00881c0 con 0x7fedd81580f0 2023-08-31T00:27:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.778+0000 7fedd77fe700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc406a0e0 0x7fedc406c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedcc001600 tx=0x7fedcc0079c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.782+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fedd81563b0 con 0x7fedd81580f0 2023-08-31T00:27:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.972+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedd81563b0 con 0x7fedd81580f0 2023-08-31T00:27:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.972+0000 7fedbffff700 1 -- 172.21.15.77:0/4175997565 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedd81563b0 con 0x7fedd81580f0 2023-08-31T00:27:12.973 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc406a0e0 msgr2=0x7fedc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc406a0e0 0x7fedc406c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fedcc001600 tx=0x7fedcc0079c0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 msgr2=0x7fedd8157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 0x7fedd8157030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fedd0007ee0 tx=0x7fedd000d3b0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 shutdown_connections 2023-08-31T00:27:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fedc406a0e0 0x7fedc406c5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedd81580f0 0x7fedd8157030 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fedd806f130 0x7fedd813df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 --2- 172.21.15.77:0/4175997565 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fedd8071000 0x7fedd813e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 >> 172.21.15.77:0/4175997565 conn(0x7fedd806cbf0 msgr2=0x7fedd815b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 shutdown_connections 2023-08-31T00:27:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:12.974+0000 7fedddb6e700 1 -- 172.21.15.77:0/4175997565 wait complete. 2023-08-31T00:27:12.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:13.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.111+0000 7f887d6f4700 1 -- 172.21.15.77:0/564078608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8878071670 msgr2=0x7f887815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.111+0000 7f887d6f4700 1 --2- 172.21.15.77:0/564078608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8878071670 0x7f887815b020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f88780cdfb0 tx=0x7f887000b380 comp rx=0 tx=0).stop 2023-08-31T00:27:13.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 -- 172.21.15.77:0/564078608 shutdown_connections 2023-08-31T00:27:13.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 --2- 172.21.15.77:0/564078608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8878071670 0x7f887815b020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 --2- 172.21.15.77:0/564078608 >> v2:172.21.15.139:3300/0 conn(0x7f887815a960 0x7f88780cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 --2- 172.21.15.77:0/564078608 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f887806d170 0x7f8878071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 -- 172.21.15.77:0/564078608 >> 172.21.15.77:0/564078608 conn(0x7f8878069d50 msgr2=0x7f887806a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:13.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 -- 172.21.15.77:0/564078608 shutdown_connections 2023-08-31T00:27:13.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.112+0000 7f887d6f4700 1 -- 172.21.15.77:0/564078608 wait complete. 2023-08-31T00:27:13.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.113+0000 7f887d6f4700 1 Processor -- start 2023-08-31T00:27:13.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.113+0000 7f887d6f4700 1 -- start start 2023-08-31T00:27:13.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f887806d170 0x7f88780ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8878071670 0x7f887814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 0x7f88781e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780adc00 con 0x7f887815a960 2023-08-31T00:27:13.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878154610 con 0x7f887806d170 2023-08-31T00:27:13.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780ae8b0 con 0x7f8878071670 2023-08-31T00:27:13.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 0x7f88781e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 0x7f88781e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39052/0 (socket says 172.21.15.77:39052) 2023-08-31T00:27:13.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 -- 172.21.15.77:0/2296004108 learned_addr learned my addr 172.21.15.77:0/2296004108 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:13.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88767fc700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8878071670 0x7f887814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f8876ffd700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f887806d170 0x7f88780ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 -- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8878071670 msgr2=0x7f887814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8878071670 0x7f887814d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 -- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f887806d170 msgr2=0x7f88780ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f887806d170 0x7f88780ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 -- 172.21.15.77:0/2296004108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870009d00 con 0x7f887815a960 2023-08-31T00:27:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f8876ffd700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f887806d170 0x7f88780ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f88777fe700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 0x7f88781e38b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88780cab70 tx=0x7f8870009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000e040 con 0x7f887815a960 2023-08-31T00:27:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f887001d690 con 0x7f887815a960 2023-08-31T00:27:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8878154860 con 0x7f887815a960 2023-08-31T00:27:13.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887001daa0 con 0x7f887815a960 2023-08-31T00:27:13.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.114+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8878154e20 con 0x7f887815a960 2023-08-31T00:27:13.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.115+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8878073c30 con 0x7f887815a960 2023-08-31T00:27:13.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.116+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f887001dc00 con 0x7f887815a960 2023-08-31T00:27:13.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.116+0000 7f885f7fe700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f886406a0e0 0x7f886406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.116+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f887008a5c0 con 0x7f887815a960 2023-08-31T00:27:13.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.116+0000 7f8876ffd700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f886406a0e0 0x7f886406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.116+0000 7f8876ffd700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f886406a0e0 0x7f886406c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f886c005d90 tx=0x7f886c005e60 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:13.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.120+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8870055db0 con 0x7f887815a960 2023-08-31T00:27:13.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.313+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f887806d670 con 0x7f887815a960 2023-08-31T00:27:13.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.313+0000 7f885f7fe700 1 -- 172.21.15.77:0/2296004108 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88700593d0 con 0x7f887815a960 2023-08-31T00:27:13.315 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:13.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f886406a0e0 msgr2=0x7f886406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f886406a0e0 0x7f886406c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f886c005d90 tx=0x7f886c005e60 comp rx=0 tx=0).stop 2023-08-31T00:27:13.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 msgr2=0x7f88781e38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 0x7f88781e38b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88780cab70 tx=0x7f8870009c30 comp rx=0 tx=0).stop 2023-08-31T00:27:13.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 shutdown_connections 2023-08-31T00:27:13.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f886406a0e0 0x7f886406c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f887815a960 0x7f88781e38b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f887806d170 0x7f88780ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.315+0000 7f887d6f4700 1 --2- 172.21.15.77:0/2296004108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8878071670 0x7f887814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.316+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 >> 172.21.15.77:0/2296004108 conn(0x7f8878069d50 msgr2=0x7f8878155ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:13.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.316+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 shutdown_connections 2023-08-31T00:27:13.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.316+0000 7f887d6f4700 1 -- 172.21.15.77:0/2296004108 wait complete. 2023-08-31T00:27:13.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 -- 172.21.15.77:0/4001373079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 msgr2=0x7f3eb815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 --2- 172.21.15.77:0/4001373079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb815c8b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80098f0 tx=0x7f3ea8009c00 comp rx=0 tx=0).stop 2023-08-31T00:27:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 -- 172.21.15.77:0/4001373079 shutdown_connections 2023-08-31T00:27:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 --2- 172.21.15.77:0/4001373079 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb815c8b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 -- 172.21.15.77:0/4001373079 >> 172.21.15.77:0/4001373079 conn(0x7f3eb8070270 msgr2=0x7f3eb8070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 -- 172.21.15.77:0/4001373079 shutdown_connections 2023-08-31T00:27:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.450+0000 7f3ebc950700 1 -- 172.21.15.77:0/4001373079 wait complete. 2023-08-31T00:27:13.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 Processor -- start 2023-08-31T00:27:13.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 -- start start 2023-08-31T00:27:13.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3eb806b230 0x7f3eb81eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 0x7f3eb80c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb80c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80c63a0 con 0x7f3eb8070d90 2023-08-31T00:27:13.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80c6680 con 0x7f3eb806b230 2023-08-31T00:27:13.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3ebc950700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80c6960 con 0x7f3eb815b730 2023-08-31T00:27:13.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3eb5d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 0x7f3eb80c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3eb5d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 0x7f3eb80c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39064/0 (socket says 172.21.15.77:39064) 2023-08-31T00:27:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.452+0000 7f3eb5d9b700 1 -- 172.21.15.77:0/2772594436 learned_addr learned my addr 172.21.15.77:0/2772594436 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb659c700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3eb806b230 0x7f3eb81eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb6d9d700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb80c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb5d9b700 1 -- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 msgr2=0x7f3eb80c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb5d9b700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb80c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb5d9b700 1 -- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3eb806b230 msgr2=0x7f3eb81eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb5d9b700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3eb806b230 0x7f3eb81eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb5d9b700 1 -- 172.21.15.77:0/2772594436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8009520 con 0x7f3eb8070d90 2023-08-31T00:27:13.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb6d9d700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb80c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:13.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3eb5d9b700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 0x7f3eb80c3590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00c580 tx=0x7f3eac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:13.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac011790 con 0x7f3eb8070d90 2023-08-31T00:27:13.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3eac0119e0 con 0x7f3eb8070d90 2023-08-31T00:27:13.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb80c6c40 con 0x7f3eb8070d90 2023-08-31T00:27:13.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac011df0 con 0x7f3eb8070d90 2023-08-31T00:27:13.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.453+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb80c60f0 con 0x7f3eb8070d90 2023-08-31T00:27:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.454+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb8073c30 con 0x7f3eb8070d90 2023-08-31T00:27:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.454+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3eac01c460 con 0x7f3eb8070d90 2023-08-31T00:27:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.455+0000 7f3ea6ffd700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3e9806a0e0 0x7f3e9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.455+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3eac088440 con 0x7f3eb8070d90 2023-08-31T00:27:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.455+0000 7f3eb659c700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3e9806a0e0 0x7f3e9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.455+0000 7f3eb659c700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3e9806a0e0 0x7f3e9806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009230 tx=0x7f3ea8019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:13.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.459+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3eac053cb0 con 0x7f3eb8070d90 2023-08-31T00:27:13.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.692+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3eb80adff0 con 0x7f3eb8070d90 2023-08-31T00:27:13.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.692+0000 7f3ea6ffd700 1 -- 172.21.15.77:0/2772594436 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f3eac0572d0 con 0x7f3eb8070d90 2023-08-31T00:27:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:13.694 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3e9806a0e0 msgr2=0x7f3e9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3e9806a0e0 0x7f3e9806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009230 tx=0x7f3ea8019040 comp rx=0 tx=0).stop 2023-08-31T00:27:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 msgr2=0x7f3eb80c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 0x7f3eb80c3590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00c580 tx=0x7f3eac00c940 comp rx=0 tx=0).stop 2023-08-31T00:27:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 shutdown_connections 2023-08-31T00:27:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3e9806a0e0 0x7f3e9806c5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3eb815b730 0x7f3eb80c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3eb806b230 0x7f3eb81eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 --2- 172.21.15.77:0/2772594436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3eb8070d90 0x7f3eb80c3590 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 >> 172.21.15.77:0/2772594436 conn(0x7f3eb8070270 msgr2=0x7f3eb80ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 shutdown_connections 2023-08-31T00:27:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.695+0000 7f3ebc950700 1 -- 172.21.15.77:0/2772594436 wait complete. 2023-08-31T00:27:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:13.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:13.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.828+0000 7fcbbe39e700 1 -- 172.21.15.77:0/3201019124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb81581a0 msgr2=0x7fcbb806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.828+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/3201019124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb81581a0 0x7fcbb806d1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcba8005fd0 tx=0x7fcba8009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.828+0000 7fcbbe39e700 1 -- 172.21.15.77:0/3201019124 shutdown_connections 2023-08-31T00:27:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.828+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/3201019124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb81581a0 0x7fcbb806d1f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.828+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/3201019124 >> v2:172.21.15.139:3300/0 conn(0x7fcbb815c5a0 0x7fcbb80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.828+0000 7fcbbe39e700 1 -- 172.21.15.77:0/3201019124 >> 172.21.15.77:0/3201019124 conn(0x7fcbb80ca8a0 msgr2=0x7fcbb80cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:13.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.829+0000 7fcbbe39e700 1 -- 172.21.15.77:0/3201019124 shutdown_connections 2023-08-31T00:27:13.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.829+0000 7fcbbe39e700 1 -- 172.21.15.77:0/3201019124 wait complete. 2023-08-31T00:27:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.830+0000 7fcbbe39e700 1 Processor -- start 2023-08-31T00:27:13.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.830+0000 7fcbbe39e700 1 -- start start 2023-08-31T00:27:13.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 0x7fcbb8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcbb81581a0 0x7fcbb80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbb815c5a0 0x7fcbb80ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80b1e10 con 0x7fcbb80af8a0 2023-08-31T00:27:13.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80b31a0 con 0x7fcbb815c5a0 2023-08-31T00:27:13.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80b2590 con 0x7fcbb81581a0 2023-08-31T00:27:13.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 0x7fcbb8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 0x7fcbb8155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39076/0 (socket says 172.21.15.77:39076) 2023-08-31T00:27:13.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 -- 172.21.15.77:0/2070192508 learned_addr learned my addr 172.21.15.77:0/2070192508 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:13.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbcb9b700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcbb81581a0 0x7fcbb80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbdb9d700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbb815c5a0 0x7fcbb80ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 -- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcbb81581a0 msgr2=0x7fcbb80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcbb81581a0 0x7fcbb80b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 -- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbb815c5a0 msgr2=0x7fcbb80ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:13.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbb815c5a0 0x7fcbb80ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:13.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 -- 172.21.15.77:0/2070192508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80095f0 con 0x7fcbb80af8a0 2023-08-31T00:27:13.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbdb9d700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbb815c5a0 0x7fcbb80ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:13.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbcb9b700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcbb81581a0 0x7fcbb80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:13.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbd39c700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 0x7fcbb8155430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009fd0 tx=0x7fcba8005140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:13.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba801d070 con 0x7fcbb80af8a0 2023-08-31T00:27:13.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcba8004320 con 0x7fcbb80af8a0 2023-08-31T00:27:13.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb80b2870 con 0x7fcbb80af8a0 2023-08-31T00:27:13.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.831+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800b750 con 0x7fcbb80af8a0 2023-08-31T00:27:13.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.832+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb80b2e30 con 0x7fcbb80af8a0 2023-08-31T00:27:13.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.832+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb804e7c0 con 0x7fcbb80af8a0 2023-08-31T00:27:13.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.833+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcba800b8b0 con 0x7fcbb80af8a0 2023-08-31T00:27:13.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.833+0000 7fcbadffb700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb9c06a0e0 0x7fcb9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:13.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.833+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcba8089cd0 con 0x7fcbb80af8a0 2023-08-31T00:27:13.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.833+0000 7fcbbcb9b700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb9c06a0e0 0x7fcb9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:13.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.834+0000 7fcbbcb9b700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb9c06a0e0 0x7fcb9c06c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4005fd0 tx=0x7fcbb4005d80 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:13.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:13.838+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcba80554a0 con 0x7fcbb80af8a0 2023-08-31T00:27:14.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.028+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbb81586c0 con 0x7fcbb80af8a0 2023-08-31T00:27:14.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.029+0000 7fcbadffb700 1 -- 172.21.15.77:0/2070192508 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fcba8058ac0 con 0x7fcbb80af8a0 2023-08-31T00:27:14.031 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:14.031 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:14.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb9c06a0e0 msgr2=0x7fcb9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb9c06a0e0 0x7fcb9c06c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4005fd0 tx=0x7fcbb4005d80 comp rx=0 tx=0).stop 2023-08-31T00:27:14.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 msgr2=0x7fcbb8155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 0x7fcbb8155430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009fd0 tx=0x7fcba8005140 comp rx=0 tx=0).stop 2023-08-31T00:27:14.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 shutdown_connections 2023-08-31T00:27:14.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb9c06a0e0 0x7fcb9c06c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbb815c5a0 0x7fcbb80ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbb80af8a0 0x7fcbb8155430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 --2- 172.21.15.77:0/2070192508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcbb81581a0 0x7fcbb80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 >> 172.21.15.77:0/2070192508 conn(0x7fcbb80ca8a0 msgr2=0x7fcbb8157390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 shutdown_connections 2023-08-31T00:27:14.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.031+0000 7fcbbe39e700 1 -- 172.21.15.77:0/2070192508 wait complete. 2023-08-31T00:27:14.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:14.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 -- 172.21.15.77:0/3908085339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2530071000 msgr2=0x7f25300c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 --2- 172.21.15.77:0/3908085339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2530071000 0x7f25300c96b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2528009f60 tx=0x7f2528009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:14.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 -- 172.21.15.77:0/3908085339 shutdown_connections 2023-08-31T00:27:14.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 --2- 172.21.15.77:0/3908085339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2530071000 0x7f25300c96b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 --2- 172.21.15.77:0/3908085339 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f253006f130 0x7f2530070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 -- 172.21.15.77:0/3908085339 >> 172.21.15.77:0/3908085339 conn(0x7f253006cbf0 msgr2=0x7f253006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:14.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 -- 172.21.15.77:0/3908085339 shutdown_connections 2023-08-31T00:27:14.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.167+0000 7f2537d27700 1 -- 172.21.15.77:0/3908085339 wait complete. 2023-08-31T00:27:14.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.168+0000 7f2537d27700 1 Processor -- start 2023-08-31T00:27:14.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.168+0000 7f2537d27700 1 -- start start 2023-08-31T00:27:14.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2537d27700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253006f130 0x7f25300c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2537d27700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 0x7f2530149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2537d27700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25301580f0 0x7f25300a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2537d27700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300a6dd0 con 0x7f2530071000 2023-08-31T00:27:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2537d27700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300c6580 con 0x7f253006f130 2023-08-31T00:27:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2537d27700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300c6860 con 0x7f25301580f0 2023-08-31T00:27:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 0x7f2530149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 0x7f2530149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39090/0 (socket says 172.21.15.77:39090) 2023-08-31T00:27:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 -- 172.21.15.77:0/1494515652 learned_addr learned my addr 172.21.15.77:0/1494515652 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:14.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f2535ac3700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253006f130 0x7f25300c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25362c4700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25301580f0 0x7f25300a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 -- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25301580f0 msgr2=0x7f25300a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25301580f0 0x7f25300a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 -- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253006f130 msgr2=0x7f25300c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253006f130 0x7f25300c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.169+0000 7f25352c2700 1 -- 172.21.15.77:0/1494515652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009c40 con 0x7f2530071000 2023-08-31T00:27:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.170+0000 7f25352c2700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 0x7f2530149d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f252400e9a0 tx=0x7f252400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.170+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524009790 con 0x7f2530071000 2023-08-31T00:27:14.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.170+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f252400cb00 con 0x7f2530071000 2023-08-31T00:27:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.170+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25300c6b40 con 0x7f2530071000 2023-08-31T00:27:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.170+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524010430 con 0x7f2530071000 2023-08-31T00:27:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.170+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300a6ac0 con 0x7f2530071000 2023-08-31T00:27:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.171+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25300c7190 con 0x7f2530071000 2023-08-31T00:27:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.171+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2524010590 con 0x7f2530071000 2023-08-31T00:27:14.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.171+0000 7f25227fc700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251406a0e0 0x7f251406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.172+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2524014070 con 0x7f2530071000 2023-08-31T00:27:14.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.172+0000 7f2535ac3700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251406a0e0 0x7f251406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.172+0000 7f2535ac3700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251406a0e0 0x7f251406c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f252c004740 tx=0x7f252c007f40 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.176+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2524051990 con 0x7f2530071000 2023-08-31T00:27:14.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.408+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2530073c30 con 0x7f2530071000 2023-08-31T00:27:14.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.408+0000 7f25227fc700 1 -- 172.21.15.77:0/1494515652 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f2524054530 con 0x7f2530071000 2023-08-31T00:27:14.410 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:14.410 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.410+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251406a0e0 msgr2=0x7f251406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.410+0000 7f2537d27700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251406a0e0 0x7f251406c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f252c004740 tx=0x7f252c007f40 comp rx=0 tx=0).stop 2023-08-31T00:27:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.410+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 msgr2=0x7f2530149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.410+0000 7f2537d27700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 0x7f2530149d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f252400e9a0 tx=0x7f252400ecb0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.410+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 shutdown_connections 2023-08-31T00:27:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f251406a0e0 0x7f251406c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25301580f0 0x7f25300a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253006f130 0x7f25300c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 --2- 172.21.15.77:0/1494515652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2530071000 0x7f2530149d40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 >> 172.21.15.77:0/1494515652 conn(0x7f253006cbf0 msgr2=0x7f25300cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 shutdown_connections 2023-08-31T00:27:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.411+0000 7f2537d27700 1 -- 172.21.15.77:0/1494515652 wait complete. 2023-08-31T00:27:14.414 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:14.826 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T00:26:59.699290+0000', 'modified': '2023-08-31T00:27:03.326289+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4374}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4374': {'gid': 4374, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/2023855175', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 2023855175}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 2023855175}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-31T00:27:14.826 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T00:27:14.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T00:27:14.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.950+0000 7febaa788700 1 -- 172.21.15.77:0/1433560434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 msgr2=0x7feb8c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.950+0000 7febaa788700 1 --2- 172.21.15.77:0/1433560434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feb8c003e20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c310 tx=0x7feb8c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:14.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.950+0000 7febaa788700 1 -- 172.21.15.77:0/1433560434 shutdown_connections 2023-08-31T00:27:14.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.951+0000 7febaa788700 1 --2- 172.21.15.77:0/1433560434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feb8c003e20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.951+0000 7febaa788700 1 -- 172.21.15.77:0/1433560434 >> 172.21.15.77:0/1433560434 conn(0x7feba406cbf0 msgr2=0x7feba406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:14.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.951+0000 7febaa788700 1 -- 172.21.15.77:0/1433560434 shutdown_connections 2023-08-31T00:27:14.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.951+0000 7febaa788700 1 -- 172.21.15.77:0/1433560434 wait complete. 2023-08-31T00:27:14.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.952+0000 7febaa788700 1 Processor -- start 2023-08-31T00:27:14.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.952+0000 7febaa788700 1 -- start start 2023-08-31T00:27:14.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7febaa788700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feba40a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7febaa788700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feba41f2ac0 0x7feba41f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7febaa788700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feba4069b10 0x7feba4069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7febaa788700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4146310 con 0x7feb8c003a00 2023-08-31T00:27:14.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7febaa788700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba406a4d0 con 0x7feba4069b10 2023-08-31T00:27:14.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7febaa788700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba41479e0 con 0x7feba41f2ac0 2023-08-31T00:27:14.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feba40a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feba40a6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39108/0 (socket says 172.21.15.77:39108) 2023-08-31T00:27:14.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 -- 172.21.15.77:0/230663427 learned_addr learned my addr 172.21.15.77:0/230663427 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:14.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 -- 172.21.15.77:0/230663427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feba41f2ac0 msgr2=0x7feba41f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feba41f2ac0 0x7feba41f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 -- 172.21.15.77:0/230663427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feba4069b10 msgr2=0x7feba4069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feba4069b10 0x7feba4069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.953+0000 7feba3fff700 1 -- 172.21.15.77:0/230663427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba41f3630 con 0x7feb8c003a00 2023-08-31T00:27:14.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.954+0000 7feba3fff700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feba40a6b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb98000c00 tx=0x7feb980011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.954+0000 7feba0ff9700 1 -- 172.21.15.77:0/230663427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980065a0 con 0x7feb8c003a00 2023-08-31T00:27:14.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.954+0000 7feba0ff9700 1 -- 172.21.15.77:0/230663427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb98003770 con 0x7feb8c003a00 2023-08-31T00:27:14.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.954+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba41f3910 con 0x7feb8c003a00 2023-08-31T00:27:14.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.954+0000 7feba0ff9700 1 -- 172.21.15.77:0/230663427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98003b80 con 0x7feb8c003a00 2023-08-31T00:27:14.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.954+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4145f30 con 0x7feb8c003a00 2023-08-31T00:27:14.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.955+0000 7feba0ff9700 1 -- 172.21.15.77:0/230663427 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb98021070 con 0x7feb8c003a00 2023-08-31T00:27:14.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.956+0000 7feba0ff9700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb9006a0e0 0x7feb9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.956+0000 7feba37fe700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb9006a0e0 0x7feb9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.956+0000 7feba0ff9700 1 -- 172.21.15.77:0/230663427 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9808a0a0 con 0x7feb8c003a00 2023-08-31T00:27:14.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.956+0000 7feba37fe700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb9006a0e0 0x7feb9006c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb94006fd0 tx=0x7feb94006b10 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 Processor -- start 2023-08-31T00:27:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 -- start start 2023-08-31T00:27:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff89287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8904630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89304a0 0x55bff8906f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff8861730 con 0x55bff89068a0 2023-08-31T00:27:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff885f050 con 0x55bff89304a0 2023-08-31T00:27:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.958+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bff885a940 con 0x55bff89283e0 2023-08-31T00:27:14.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8904630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8904630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39118/0 (socket says 172.21.15.77:39118) 2023-08-31T00:27:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 -- 172.21.15.77:0/4057290485 learned_addr learned my addr 172.21.15.77:0/4057290485 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba8d25700 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89304a0 0x55bff8906f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba3fff700 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff89287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 -- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 msgr2=0x55bff89287c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff89287c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 -- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89304a0 msgr2=0x55bff8906f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89304a0 0x55bff8906f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 -- 172.21.15.77:0/4057290485 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bff86da5e0 con 0x55bff89068a0 2023-08-31T00:27:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba8d25700 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89304a0 0x55bff8906f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feba37fe700 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8904630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feb94006db0 tx=0x7feb94011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd27c19e85b9cff server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feb89ffb700 1 -- 172.21.15.77:0/4057290485 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94016040 con 0x55bff89068a0 2023-08-31T00:27:14.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feb89ffb700 1 -- 172.21.15.77:0/4057290485 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb9401d3c0 con 0x55bff89068a0 2023-08-31T00:27:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.959+0000 7feb89ffb700 1 -- 172.21.15.77:0/4057290485 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9401d770 con 0x55bff89068a0 2023-08-31T00:27:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 -- 172.21.15.77:0/4057290485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 msgr2=0x55bff8904630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8904630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feb94006db0 tx=0x7feb94011000 comp rx=0 tx=0).stop 2023-08-31T00:27:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 -- 172.21.15.77:0/4057290485 shutdown_connections 2023-08-31T00:27:14.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff89287c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89304a0 0x55bff8906f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 --2- 172.21.15.77:0/4057290485 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8904630 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 -- 172.21.15.77:0/4057290485 >> 172.21.15.77:0/4057290485 conn(0x55bff887d090 msgr2=0x55bff894e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:14.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 -- 172.21.15.77:0/4057290485 shutdown_connections 2023-08-31T00:27:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 -- 172.21.15.77:0/4057290485 wait complete. 2023-08-31T00:27:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.960+0000 7febb692bb80 1 -- start start 2023-08-31T00:27:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 Processor -- start 2023-08-31T00:27:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8936270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89283e0 0x55bff8960c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89304a0 0x55bff8961150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff87f8b60 con 0x55bff89068a0 2023-08-31T00:27:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff87f8860 con 0x55bff89283e0 2023-08-31T00:27:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bff86dc8d0 con 0x55bff89304a0 2023-08-31T00:27:14.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7feba3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8936270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7febb692bb80 10 client.0 _ll_register_callbacks cb 0x55bff8742a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T00:27:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7feba3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8936270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39122/0 (socket says 172.21.15.77:39122) 2023-08-31T00:27:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.961+0000 7feba3fff700 1 -- 172.21.15.77:0/4059714028 learned_addr learned my addr 172.21.15.77:0/4059714028 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba37fe700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89283e0 0x55bff8960c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba8d25700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89304a0 0x55bff8961150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba3fff700 1 -- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89304a0 msgr2=0x55bff8961150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:14.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba3fff700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89304a0 0x55bff8961150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba3fff700 1 -- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89283e0 msgr2=0x55bff8960c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:14.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba3fff700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89283e0 0x55bff8960c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba3fff700 1 -- 172.21.15.77:0/4059714028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba40ccb30 con 0x55bff89068a0 2023-08-31T00:27:14.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba37fe700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89283e0 0x55bff8960c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:14.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba3fff700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8936270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c900 tx=0x7feb98058fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5fe70832f48bda server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feb82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-08-31T00:27:14.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feb82ffd700 1 -- 172.21.15.77:0/4059714028 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98059530 con 0x55bff89068a0 2023-08-31T00:27:14.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feb82ffd700 1 -- 172.21.15.77:0/4059714028 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9805d360 con 0x55bff89068a0 2023-08-31T00:27:14.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bff88fb970 con 0x55bff89068a0 2023-08-31T00:27:14.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feb82ffd700 1 -- 172.21.15.77:0/4059714028 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb98055890 con 0x55bff89068a0 2023-08-31T00:27:14.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 10 client.4740 fetch_fsmap learned FSMap version 8 2023-08-31T00:27:14.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55bff8686d90 con 0x55bff89068a0 2023-08-31T00:27:14.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feb82ffd700 1 -- 172.21.15.77:0/4059714028 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55bff88fb970 con 0x55bff89068a0 2023-08-31T00:27:14.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feb82ffd700 1 -- 172.21.15.77:0/4059714028 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb98060e20 con 0x55bff89068a0 2023-08-31T00:27:14.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 10 client.4740 fetch_fsmap finished waiting for FSMap version 8 2023-08-31T00:27:14.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 10 client.4740 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T00:27:14.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 20 client.4740 populate_metadata read hostname 'smithi077' 2023-08-31T00:27:14.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff89279a0 0x55bff895d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 4 client.4740 mds_command: new command op to 4374 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T00:27:14.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 --> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bff8853920 con 0x55bff89279a0 2023-08-31T00:27:14.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.962+0000 7feba37fe700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff89279a0 0x55bff895d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7feba37fe700 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff89279a0 0x55bff895d620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a8bad484627079 server_cookie=4c276bb02f818596 in_seq=0 out_seq=0 2023-08-31T00:27:14.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7feb82ffd700 10 client.4740 ms_handle_connect on v2:172.21.15.77:6835/2023855175 2023-08-31T00:27:14.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7feb82ffd700 1 -- 172.21.15.77:0/4059714028 <== mds.0 v2:172.21.15.77:6835/2023855175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bff8853920 con 0x55bff89279a0 2023-08-31T00:27:14.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7feb82ffd700 10 client.4740 handle_command_reply: tid=0 2023-08-31T00:27:14.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 client.4740 shutdown 2023-08-31T00:27:14.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 msgr2=0x55bff8936270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8936270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feb9800c900 tx=0x7feb98058fc0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 shutdown_connections 2023-08-31T00:27:14.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89304a0 0x55bff8961150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff89279a0 0x55bff895d620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89068a0 0x55bff8936270 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7feb82ffd700 0 client.4740 ms_handle_reset on v2:172.21.15.77:6835/2023855175 2023-08-31T00:27:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 --2- 172.21.15.77:0/4059714028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89283e0 0x55bff8960c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.963+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 >> 172.21.15.77:0/4059714028 conn(0x55bff887d090 msgr2=0x55bff894e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.964+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 shutdown_connections 2023-08-31T00:27:14.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.964+0000 7febb692bb80 1 -- 172.21.15.77:0/4059714028 wait complete. 2023-08-31T00:27:14.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.964+0000 7febb692bb80 20 client.4740 trim_cache size 0 max 16384 2023-08-31T00:27:14.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.981+0000 7febb692bb80 1 Processor -- start 2023-08-31T00:27:14.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.981+0000 7febb692bb80 1 -- start start 2023-08-31T00:27:14.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff8909510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff8926860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7febb692bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff8908590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:14.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7febb692bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff8935af0 con 0x55bff89304a0 2023-08-31T00:27:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff88fccf0 con 0x55bff89068a0 2023-08-31T00:27:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bff8933d80 con 0x55bff89283e0 2023-08-31T00:27:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff8908590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff8908590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39134/0 (socket says 172.21.15.77:39134) 2023-08-31T00:27:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 -- 172.21.15.77:0/677435171 learned_addr learned my addr 172.21.15.77:0/677435171 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:14.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba3fff700 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff8909510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba37fe700 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff8926860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 -- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 msgr2=0x55bff8926860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff8926860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 -- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 msgr2=0x55bff8909510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff8909510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 -- 172.21.15.77:0/677435171 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bff866fc10 con 0x55bff89304a0 2023-08-31T00:27:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feba8d25700 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff8908590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feba40cb650 tx=0x7feb9c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7722a211293744 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:14.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feb8a7fc700 1 -- 172.21.15.77:0/677435171 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00e040 con 0x55bff89304a0 2023-08-31T00:27:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feb8a7fc700 1 -- 172.21.15.77:0/677435171 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb9c00f040 con 0x55bff89304a0 2023-08-31T00:27:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.982+0000 7feb8a7fc700 1 -- 172.21.15.77:0/677435171 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c008af0 con 0x55bff89304a0 2023-08-31T00:27:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 -- 172.21.15.77:0/677435171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 msgr2=0x55bff8908590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:14.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff8908590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feba40cb650 tx=0x7feb9c009310 comp rx=0 tx=0).stop 2023-08-31T00:27:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 -- 172.21.15.77:0/677435171 shutdown_connections 2023-08-31T00:27:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff8908590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff8909510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 --2- 172.21.15.77:0/677435171 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff8926860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 -- 172.21.15.77:0/677435171 >> 172.21.15.77:0/677435171 conn(0x55bff887d090 msgr2=0x55bff892b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:15.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 -- 172.21.15.77:0/677435171 shutdown_connections 2023-08-31T00:27:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 -- 172.21.15.77:0/677435171 wait complete. 2023-08-31T00:27:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.983+0000 7febb692bb80 1 -- start start 2023-08-31T00:27:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 Processor -- start 2023-08-31T00:27:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff89b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff896e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff892a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff89357d0 con 0x55bff89304a0 2023-08-31T00:27:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bff896eaf0 con 0x55bff89068a0 2023-08-31T00:27:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bff896bd90 con 0x55bff89283e0 2023-08-31T00:27:15.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7febb692bb80 10 client.0 _ll_register_callbacks cb 0x7feb98059390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T00:27:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7feba8d25700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff892a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7feba8d25700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff892a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39140/0 (socket says 172.21.15.77:39140) 2023-08-31T00:27:15.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.984+0000 7feba8d25700 1 -- 172.21.15.77:0/3923094515 learned_addr learned my addr 172.21.15.77:0/3923094515 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba3fff700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff89b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba37fe700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff896e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba8d25700 1 -- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 msgr2=0x55bff896e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba8d25700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff896e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba8d25700 1 -- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 msgr2=0x55bff89b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:27:15.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba8d25700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff89b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba8d25700 1 -- 172.21.15.77:0/3923094515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c009040 con 0x55bff89304a0 2023-08-31T00:27:15.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feba8d25700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff892a120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feb9c003fd0 tx=0x7feb9c008ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491b2a69088f4ef0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:15.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feb82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-08-31T00:27:15.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feb82ffd700 1 -- 172.21.15.77:0/3923094515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00e070 con 0x55bff89304a0 2023-08-31T00:27:15.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb9401d3c0 con 0x55bff89304a0 2023-08-31T00:27:15.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feb82ffd700 1 -- 172.21.15.77:0/3923094515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9c004230 con 0x55bff89304a0 2023-08-31T00:27:15.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feb82ffd700 1 -- 172.21.15.77:0/3923094515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb9c0043f0 con 0x55bff89304a0 2023-08-31T00:27:15.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 10 client.4746 fetch_fsmap learned FSMap version 8 2023-08-31T00:27:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55bff86ad200 con 0x55bff89304a0 2023-08-31T00:27:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feb82ffd700 1 -- 172.21.15.77:0/3923094515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb9401d3c0 con 0x55bff89304a0 2023-08-31T00:27:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7feb82ffd700 1 -- 172.21.15.77:0/3923094515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb9c004640 con 0x55bff89304a0 2023-08-31T00:27:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 10 client.4746 fetch_fsmap finished waiting for FSMap version 8 2023-08-31T00:27:15.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 10 client.4746 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T00:27:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 20 client.4746 populate_metadata read hostname 'smithi077' 2023-08-31T00:27:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff88fcff0 0x55bff88fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 4 client.4746 mds_command: new command op to 4374 tid=0[{"prefix": "status"}] 2023-08-31T00:27:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.985+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 --> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bff8814000 con 0x55bff88fcff0 2023-08-31T00:27:15.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7feba3fff700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff88fcff0 0x55bff88fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7feb82ffd700 10 client.4746 ms_handle_connect on v2:172.21.15.77:6835/2023855175 2023-08-31T00:27:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7feba3fff700 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff88fcff0 0x55bff88fd3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c1f83f041db8eb server_cookie=7f8eb9d6685c4697 in_seq=0 out_seq=0 2023-08-31T00:27:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7feb82ffd700 1 -- 172.21.15.77:0/3923094515 <== mds.0 v2:172.21.15.77:6835/2023855175 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55bff8814000 con 0x55bff88fcff0 2023-08-31T00:27:15.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7feb82ffd700 10 client.4746 handle_command_reply: tid=0 2023-08-31T00:27:15.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 client.4746 shutdown 2023-08-31T00:27:15.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 msgr2=0x55bff892a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff892a120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feb9c003fd0 tx=0x7feb9c008ac0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 shutdown_connections 2023-08-31T00:27:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:6835/2023855175,v1:172.21.15.77:6837/2023855175] conn(0x55bff88fcff0 0x55bff88fd3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55bff89304a0 0x55bff892a120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bff89068a0 0x55bff89b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7feb82ffd700 0 client.4746 ms_handle_reset on v2:172.21.15.77:6835/2023855175 2023-08-31T00:27:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 --2- 172.21.15.77:0/3923094515 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55bff89283e0 0x55bff896e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 >> 172.21.15.77:0/3923094515 conn(0x55bff887d090 msgr2=0x55bff89045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:15.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 shutdown_connections 2023-08-31T00:27:15.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 1 -- 172.21.15.77:0/3923094515 wait complete. 2023-08-31T00:27:15.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.986+0000 7febb692bb80 20 client.4746 trim_cache size 0 max 16384 2023-08-31T00:27:15.013 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-08-31T00:27:15.013 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "cd1ac960-5b19-4e71-9e49-9da190b0a8ec", 2023-08-31T00:27:15.013 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-08-31T00:27:15.013 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4374, 2023-08-31T00:27:15.014 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-08-31T00:27:15.014 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-08-31T00:27:15.014 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-08-31T00:27:15.014 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 14.681309239999999, 2023-08-31T00:27:15.014 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 8, 2023-08-31T00:27:15.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 20, 2023-08-31T00:27:15.015 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 20, 2023-08-31T00:27:15.015 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 22.304594957999999 2023-08-31T00:27:15.015 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-08-31T00:27:15.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb9006a0e0 msgr2=0x7feb9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb9006a0e0 0x7feb9006c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb94006fd0 tx=0x7feb94006b10 comp rx=0 tx=0).stop 2023-08-31T00:27:15.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 msgr2=0x7feba40a6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feba40a6b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb98000c00 tx=0x7feb980011c0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 shutdown_connections 2023-08-31T00:27:15.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7feb9006a0e0 0x7feb9006c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feba4069b10 0x7feba4069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb8c003a00 0x7feba40a6b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 --2- 172.21.15.77:0/230663427 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feba41f2ac0 0x7feba41f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 >> 172.21.15.77:0/230663427 conn(0x7feba406cbf0 msgr2=0x7feba4158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:15.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 shutdown_connections 2023-08-31T00:27:15.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:14.987+0000 7febaa788700 1 -- 172.21.15.77:0/230663427 wait complete. 2023-08-31T00:27:15.020 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-31T00:27:15.048 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-31T00:27:15.049 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-31T00:27:15.049 INFO:tasks.ceph_fuse:client.0 config is {} 2023-08-31T00:27:15.050 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T00:27:15.050 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:15.051 INFO:tasks.ceph_fuse:client.2 config is {} 2023-08-31T00:27:15.051 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T00:27:15.051 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:15.052 INFO:tasks.ceph_fuse:client.1 config is {} 2023-08-31T00:27:15.052 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T00:27:15.052 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:15.052 INFO:tasks.ceph_fuse:client.3 config is {} 2023-08-31T00:27:15.053 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T00:27:15.053 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:15.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.054 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-08-31T00:27:15.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-08-31T00:27:15.140 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2023-08-31T00:27:15.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:27:15.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.142 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-08-31T00:27:15.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2023-08-31T00:27:15.240 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2023-08-31T00:27:15.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:27:15.242 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-31T00:27:15.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T00:27:15.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 -- 172.21.15.77:0/3286359284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155bc0 msgr2=0x7ffb84159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/3286359284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155bc0 0x7ffb84159300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb840ac990 tx=0x7ffb74009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 -- 172.21.15.77:0/3286359284 shutdown_connections 2023-08-31T00:27:15.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/3286359284 >> v2:172.21.15.139:3300/0 conn(0x7ffb840cd1f0 0x7ffb840cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/3286359284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155bc0 0x7ffb84159300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 -- 172.21.15.77:0/3286359284 >> 172.21.15.77:0/3286359284 conn(0x7ffb84069d50 msgr2=0x7ffb8406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:15.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 -- 172.21.15.77:0/3286359284 shutdown_connections 2023-08-31T00:27:15.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.368+0000 7ffb8bd55700 1 -- 172.21.15.77:0/3286359284 wait complete. 2023-08-31T00:27:15.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.369+0000 7ffb8bd55700 1 Processor -- start 2023-08-31T00:27:15.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.369+0000 7ffb8bd55700 1 -- start start 2023-08-31T00:27:15.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb840cd1f0 0x7ffb841480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffb84155bc0 0x7ffb84149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 0x7ffb841e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840abc20 con 0x7ffb84155fa0 2023-08-31T00:27:15.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840abf00 con 0x7ffb840cd1f0 2023-08-31T00:27:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840ac1e0 con 0x7ffb84155bc0 2023-08-31T00:27:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 0x7ffb841e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 0x7ffb841e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39152/0 (socket says 172.21.15.77:39152) 2023-08-31T00:27:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 -- 172.21.15.77:0/2366154988 learned_addr learned my addr 172.21.15.77:0/2366154988 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb89af1700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb840cd1f0 0x7ffb841480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb892f0700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffb84155bc0 0x7ffb84149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 -- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffb84155bc0 msgr2=0x7ffb84149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffb84155bc0 0x7ffb84149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 -- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb840cd1f0 msgr2=0x7ffb841480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb840cd1f0 0x7ffb841480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 -- 172.21.15.77:0/2366154988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74009520 con 0x7ffb84155fa0 2023-08-31T00:27:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb892f0700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffb84155bc0 0x7ffb84149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8a2f2700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 0x7ffb841e2ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00ef30 tx=0x7ffb7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c018070 con 0x7ffb84155fa0 2023-08-31T00:27:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb7c00f040 con 0x7ffb84155fa0 2023-08-31T00:27:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb84159980 con 0x7ffb84155fa0 2023-08-31T00:27:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c004bb0 con 0x7ffb84155fa0 2023-08-31T00:27:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.370+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb841485e0 con 0x7ffb84155fa0 2023-08-31T00:27:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.371+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb84159ea0 con 0x7ffb84155fa0 2023-08-31T00:27:15.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.372+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffb7c004d10 con 0x7ffb84155fa0 2023-08-31T00:27:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.372+0000 7ffb7a7fc700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ffb6806a110 0x7ffb6806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.372+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb7c088410 con 0x7ffb84155fa0 2023-08-31T00:27:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.372+0000 7ffb89af1700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ffb6806a110 0x7ffb6806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:15.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.373+0000 7ffb89af1700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ffb6806a110 0x7ffb6806c5d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009230 tx=0x7ffb74019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.376+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffb84159ea0 con 0x7ffb84155fa0 2023-08-31T00:27:15.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.613+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb84159ea0 con 0x7ffb84155fa0 2023-08-31T00:27:15.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.613+0000 7ffb7a7fc700 1 -- 172.21.15.77:0/2366154988 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb84159ea0 con 0x7ffb84155fa0 2023-08-31T00:27:15.615 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T00:27:15.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ffb6806a110 msgr2=0x7ffb6806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ffb6806a110 0x7ffb6806c5d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009230 tx=0x7ffb74019040 comp rx=0 tx=0).stop 2023-08-31T00:27:15.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 msgr2=0x7ffb841e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:15.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 0x7ffb841e2ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00ef30 tx=0x7ffb7c00c3a0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 shutdown_connections 2023-08-31T00:27:15.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ffb6806a110 0x7ffb6806c5d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb84155fa0 0x7ffb841e2ed0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb840cd1f0 0x7ffb841480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 --2- 172.21.15.77:0/2366154988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ffb84155bc0 0x7ffb84149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 >> 172.21.15.77:0/2366154988 conn(0x7ffb84069d50 msgr2=0x7ffb8414a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 shutdown_connections 2023-08-31T00:27:15.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:15.615+0000 7ffb8bd55700 1 -- 172.21.15.77:0/2366154988 wait complete. 2023-08-31T00:27:15.628 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T00:27:15.628 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T00:27:15.629 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-08-31T00:27:15.629 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T00:27:15.629 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:15.630 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T00:27:15.630 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T00:27:15.630 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T00:27:15.630 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T00:27:15.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.631 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-08-31T00:27:15.649 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:15.649 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:15.649 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:15.649 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:15.650 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:15.650 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:15.651 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:15.651 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:15.651 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:15.651 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:15.651 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:15.652 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:15.652 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T00:27:15.652 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:15.652 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T00:27:15.653 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42314sec preferred_lft 42314sec 2023-08-31T00:27:15.653 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::4efd:2ec9:41be:dee6/64 scope link noprefixroute 2023-08-31T00:27:15.653 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:15.653 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T00:27:15.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.654 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:15.655 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:15.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2023-08-31T00:27:15.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2023-08-31T00:27:15.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2023-08-31T00:27:15.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T00:27:15.656 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:15.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.838 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T00:27:15.867 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-08-31T00:27:15.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.868 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-08-31T00:27:15.937 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-08-31T00:27:15.937 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T00:27:15.938 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T00:27:15.938 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T00:27:15.938 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T00:27:15.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:15.939 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:15.939 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:15.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T00:27:15.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T00:27:15.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T00:27:15.940 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:16.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:16.189 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-08-31T00:27:16.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:16.207 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-08-31T00:27:16.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:16.263 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:16.264 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:16.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T00:27:16.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-31T00:27:16.265 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:16.358 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-31T00:27:16.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:16.359 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:16.359 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:16.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-31T00:27:16.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T00:27:16.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-31T00:27:16.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-31T00:27:16.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-31T00:27:16.361 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:16.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:16.564 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:16.565 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:16.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-08-31T00:27:16.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T00:27:16.566 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:16.669 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-31T00:27:16.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:16.669 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:16.689 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-31T00:27:16.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:16.689 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:16.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-08-31T00:27:16.813 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:16.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:16.880 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:16.880 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:16.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:16.882 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-08-31T00:27:16.938 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T00:27:16.939 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-31T00:27:16.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-08-31T00:27:17.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:17.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:17.074 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:17.075 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:17.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:17.076 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-08-31T00:27:17.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-08-31T00:27:17.078+0000 7f065e0af5c0 -1 init, newargv = 0x5571a0a71290 newargc=15 2023-08-31T00:27:17.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[113857]: starting ceph client 2023-08-31T00:27:17.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[113857]: starting fuse 2023-08-31T00:27:17.096 INFO:teuthology.orchestra.run.smithi077.stdout:47 2023-08-31T00:27:17.097 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T00:27:17.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-08-31T00:27:17.098 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-08-31T00:27:17.099 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-08-31T00:27:17.099 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-08-31T00:27:17.099 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-08-31T00:27:17.100 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:17.100 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-08-31T00:27:17.100 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-31T00:27:17.101 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-08-31T00:27:17.101 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-31T00:27:17.101 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:17.102 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-08-31T00:27:17.102 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-08-31T00:27:17.103 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-08-31T00:27:17.103 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-08-31T00:27:17.103 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:17.104 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-08-31T00:27:17.104 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T00:27:17.104 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T00:27:17.105 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T00:27:17.105 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-08-31T00:27:17.105 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-08-31T00:27:17.107 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-08-31T00:27:17.107 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T00:27:17.107 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:17.108 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-08-31T00:27:17.108 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-08-31T00:27:17.219 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.113857.asok 2023-08-31T00:27:17.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T00:27:17.228 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.113857.asok 2023-08-31T00:27:17.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:17.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.113857.asok status 2023-08-31T00:27:17.385 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-08-31T00:27:17.385 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-08-31T00:27:17.385 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T00:27:17.385 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T00:27:17.386 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-08-31T00:27:17.386 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-08-31T00:27:17.386 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-31T00:27:17.386 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "113857", 2023-08-31T00:27:17.387 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-08-31T00:27:17.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:17.387 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-08-31T00:27:17.387 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-08-31T00:27:17.387 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4764, 2023-08-31T00:27:17.388 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-08-31T00:27:17.388 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-08-31T00:27:17.388 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-08-31T00:27:17.388 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4764 2023-08-31T00:27:17.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:17.389 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-08-31T00:27:17.389 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-08-31T00:27:17.389 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-08-31T00:27:17.389 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2008433036 2023-08-31T00:27:17.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:17.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:17.390 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-08-31T00:27:17.390 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-08-31T00:27:17.391 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-08-31T00:27:17.391 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2008433036 2023-08-31T00:27:17.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:17.391 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4764 192.168.0.1:0/2008433036", 2023-08-31T00:27:17.391 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2008433036", 2023-08-31T00:27:17.392 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-08-31T00:27:17.392 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 8, 2023-08-31T00:27:17.392 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 20, 2023-08-31T00:27:17.392 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-08-31T00:27:17.392 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-08-31T00:27:17.393 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-08-31T00:27:17.393 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-08-31T00:27:17.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T00:27:17.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 -- 172.21.15.77:0/2466252998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498005210 msgr2=0x7f649800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:17.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 --2- 172.21.15.77:0/2466252998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498005210 0x7f649800ba10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f64a400e320 tx=0x7f6498005880 comp rx=0 tx=0).stop 2023-08-31T00:27:17.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 -- 172.21.15.77:0/2466252998 shutdown_connections 2023-08-31T00:27:17.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 --2- 172.21.15.77:0/2466252998 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498005210 0x7f649800ba10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 -- 172.21.15.77:0/2466252998 >> 172.21.15.77:0/2466252998 conn(0x7f64ac070270 msgr2=0x7f64ac070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:17.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 -- 172.21.15.77:0/2466252998 shutdown_connections 2023-08-31T00:27:17.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.518+0000 7f64b38b5700 1 -- 172.21.15.77:0/2466252998 wait complete. 2023-08-31T00:27:17.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.520+0000 7f64b38b5700 1 Processor -- start 2023-08-31T00:27:17.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.520+0000 7f64b38b5700 1 -- start start 2023-08-31T00:27:17.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b38b5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6498005210 0x7f64ac0c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:17.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b38b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 0x7f64ac0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:17.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b38b5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64ac0ae5b0 0x7f64ac0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:17.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b38b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c5cd0 con 0x7f64ac1e4560 2023-08-31T00:27:17.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b38b5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c5fb0 con 0x7f6498005210 2023-08-31T00:27:17.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b38b5700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c6290 con 0x7f64ac0ae5b0 2023-08-31T00:27:17.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 0x7f64ac0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:17.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 0x7f64ac0b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39186/0 (socket says 172.21.15.77:39186) 2023-08-31T00:27:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 -- 172.21.15.77:0/1314696824 learned_addr learned my addr 172.21.15.77:0/1314696824 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b1651700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6498005210 0x7f64ac0c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b1e52700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64ac0ae5b0 0x7f64ac0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 -- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64ac0ae5b0 msgr2=0x7f64ac0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:17.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64ac0ae5b0 0x7f64ac0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 -- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6498005210 msgr2=0x7f64ac0c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:17.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6498005210 0x7f64ac0c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 -- 172.21.15.77:0/1314696824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0c6570 con 0x7f64ac1e4560 2023-08-31T00:27:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64b0e50700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 0x7f64ac0b2430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64a8003f50 tx=0x7f64a8001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.521+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8011630 con 0x7f64ac1e4560 2023-08-31T00:27:17.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.522+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64a8011790 con 0x7f64ac1e4560 2023-08-31T00:27:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.522+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0c6850 con 0x7f64ac1e4560 2023-08-31T00:27:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.522+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8011b80 con 0x7f64ac1e4560 2023-08-31T00:27:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.522+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac1e49e0 con 0x7f64ac1e4560 2023-08-31T00:27:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.523+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac073c30 con 0x7f64ac1e4560 2023-08-31T00:27:17.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.523+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64a8011ce0 con 0x7f64ac1e4560 2023-08-31T00:27:17.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.523+0000 7f64a1ffb700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f649006a0e0 0x7f649006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.523+0000 7f64b1651700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f649006a0e0 0x7f649006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.523+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64a80890b0 con 0x7f64ac1e4560 2023-08-31T00:27:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.524+0000 7f64b1651700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f649006a0e0 0x7f649006c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f649c001eb0 tx=0x7f649c006040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:17.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.528+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f64a8054870 con 0x7f64ac1e4560 2023-08-31T00:27:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.762+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64ac065ec0 con 0x7f64ac1e4560 2023-08-31T00:27:17.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.762+0000 7f64a1ffb700 1 -- 172.21.15.77:0/1314696824 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64a801f070 con 0x7f64ac1e4560 2023-08-31T00:27:17.764 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T00:27:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f649006a0e0 msgr2=0x7f649006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f649006a0e0 0x7f649006c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f649c001eb0 tx=0x7f649c006040 comp rx=0 tx=0).stop 2023-08-31T00:27:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 msgr2=0x7f64ac0b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 0x7f64ac0b2430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64a8003f50 tx=0x7f64a8001540 comp rx=0 tx=0).stop 2023-08-31T00:27:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 shutdown_connections 2023-08-31T00:27:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f649006a0e0 0x7f649006c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64ac0ae5b0 0x7f64ac0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6498005210 0x7f64ac0c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 --2- 172.21.15.77:0/1314696824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac1e4560 0x7f64ac0b2430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.764+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 >> 172.21.15.77:0/1314696824 conn(0x7f64ac070270 msgr2=0x7f64ac0b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.765+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 shutdown_connections 2023-08-31T00:27:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:17.765+0000 7f64b38b5700 1 -- 172.21.15.77:0/1314696824 wait complete. 2023-08-31T00:27:17.777 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T00:27:17.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T00:27:17.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-08-31T00:27:17.778 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-31T00:27:17.778 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:17.778 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T00:27:17.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T00:27:17.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T00:27:17.779 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-31T00:27:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:17.779 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-08-31T00:27:17.797 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:17.913 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:17.913 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:17.913 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:17.913 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:17.914 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:17.914 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:17.915 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:17.915 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:17.915 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:17.916 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T00:27:17.916 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:17.916 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T00:27:17.916 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-08-31T00:27:17.916 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::4efd:2ec9:41be:dee6/64 scope link noprefixroute 2023-08-31T00:27:17.917 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:27:17.917 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0a:55:97:80:44:3f brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:17.917 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T00:27:17.917 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:17.918 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c83c:e4ff:fea6:d38a/64 scope link 2023-08-31T00:27:17.919 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T00:27:17.919 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0a:55:97:80:44:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T00:27:17.919 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::855:97ff:fe80:443f/64 scope link tentative 2023-08-31T00:27:17.919 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:17.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:17.920 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T00:27:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-08-31T00:27:17.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:17.950 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-08-31T00:27:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-08-31T00:27:18.009 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T00:27:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T00:27:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T00:27:18.010 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T00:27:18.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.011 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:18.011 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:18.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T00:27:18.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T00:27:18.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T00:27:18.012 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:18.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.114 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-08-31T00:27:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T00:27:18.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.132 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-08-31T00:27:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-31T00:27:18.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.189 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:18.190 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:18.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T00:27:18.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-31T00:27:18.191 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:18.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T00:27:18.320 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.322 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:27:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether d6:fe:67:27:de:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T00:27:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T00:27:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::d4fe:67ff:fe27:de12/64 scope link 2023-08-31T00:27:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T00:27:18.412 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:18.412 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:18.413 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:18.413 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.413 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:18.413 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.414 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:27:18.414 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether d6:fe:67:27:de:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T00:27:18.414 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T00:27:18.414 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.414 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::d4fe:67ff:fe27:de12/64 scope link 2023-08-31T00:27:18.415 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:18.434 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-31T00:27:18.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.435 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:18.435 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:18.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-31T00:27:18.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T00:27:18.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-31T00:27:18.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-31T00:27:18.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-31T00:27:18.437 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:18.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:18.678 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:27:18.679 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:27:18.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2023-08-31T00:27:18.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T00:27:18.680 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:27:18.787 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-08-31T00:27:18.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:18.788 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-31T00:27:18.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:18.814 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:18.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-08-31T00:27:18.937 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:18.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:19.003 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:19.004 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:19.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:19.005 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-08-31T00:27:19.061 INFO:teuthology.orchestra.run.smithi077.stdout:47 2023-08-31T00:27:19.062 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-08-31T00:27:19.062 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-08-31T00:27:19.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-08-31T00:27:19.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:19.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:19.190 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:2023-08-31T00:27:19.189+0000 7f88320005c0 -1 init, newargv = 0x55a37647c210 newargc=15 2023-08-31T00:27:19.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[114499]: starting ceph client 2023-08-31T00:27:19.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[114499]: starting fuse 2023-08-31T00:27:19.199 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:19.200 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:19.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:19.201 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-08-31T00:27:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:47 2023-08-31T00:27:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:48 2023-08-31T00:27:19.259 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-08-31T00:27:19.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-08-31T00:27:19.260 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-08-31T00:27:19.260 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-08-31T00:27:19.260 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-08-31T00:27:19.261 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-08-31T00:27:19.261 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:19.261 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-08-31T00:27:19.261 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-08-31T00:27:19.262 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-08-31T00:27:19.262 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-08-31T00:27:19.262 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:19.263 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-08-31T00:27:19.263 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-08-31T00:27:19.263 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-08-31T00:27:19.263 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-08-31T00:27:19.264 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:19.264 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-08-31T00:27:19.264 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T00:27:19.265 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T00:27:19.265 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T00:27:19.265 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-08-31T00:27:19.265 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-08-31T00:27:19.266 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-08-31T00:27:19.266 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T00:27:19.266 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:27:19.267 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.2")) 2023-08-31T00:27:19.267 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-08-31T00:27:19.382 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.2.114499.asok 2023-08-31T00:27:19.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T00:27:19.392 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.114499.asok 2023-08-31T00:27:19.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:19.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.114499.asok status 2023-08-31T00:27:19.548 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-08-31T00:27:19.548 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-08-31T00:27:19.548 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T00:27:19.549 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T00:27:19.549 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "2", 2023-08-31T00:27:19.549 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-08-31T00:27:19.550 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-08-31T00:27:19.550 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "114499", 2023-08-31T00:27:19.550 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-08-31T00:27:19.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:19.550 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-08-31T00:27:19.551 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-08-31T00:27:19.551 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4776, 2023-08-31T00:27:19.551 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-08-31T00:27:19.551 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-08-31T00:27:19.551 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-08-31T00:27:19.552 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4776 2023-08-31T00:27:19.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:19.552 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-08-31T00:27:19.552 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-08-31T00:27:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2023-08-31T00:27:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2284554499 2023-08-31T00:27:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-08-31T00:27:19.554 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-08-31T00:27:19.554 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2023-08-31T00:27:19.554 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2284554499 2023-08-31T00:27:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4776 192.168.0.2:0/2284554499", 2023-08-31T00:27:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.2:0/2284554499", 2023-08-31T00:27:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-08-31T00:27:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 8, 2023-08-31T00:27:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 20, 2023-08-31T00:27:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-08-31T00:27:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-08-31T00:27:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-08-31T00:27:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-08-31T00:27:19.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T00:27:19.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.680+0000 7fd45f1e8700 1 -- 172.21.15.77:0/1499240525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd45815dc10 msgr2=0x7fd458159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:19.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.680+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/1499240525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd45815dc10 0x7fd458159e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd450009fd0 tx=0x7fd45000b380 comp rx=0 tx=0).stop 2023-08-31T00:27:19.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.681+0000 7fd45f1e8700 1 -- 172.21.15.77:0/1499240525 shutdown_connections 2023-08-31T00:27:19.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.681+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/1499240525 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd45815dc10 0x7fd458159e50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.681+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/1499240525 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd4580c9ee0 0x7fd458159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.681+0000 7fd45f1e8700 1 -- 172.21.15.77:0/1499240525 >> 172.21.15.77:0/1499240525 conn(0x7fd4580cf180 msgr2=0x7fd4580cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:19.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.681+0000 7fd45f1e8700 1 -- 172.21.15.77:0/1499240525 shutdown_connections 2023-08-31T00:27:19.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.681+0000 7fd45f1e8700 1 -- 172.21.15.77:0/1499240525 wait complete. 2023-08-31T00:27:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.682+0000 7fd45f1e8700 1 Processor -- start 2023-08-31T00:27:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.682+0000 7fd45f1e8700 1 -- start start 2023-08-31T00:27:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 0x7fd4580c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd458159530 0x7fd4581581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dc10 0x7fd4580c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4581434c0 con 0x7fd4580c9ee0 2023-08-31T00:27:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458143760 con 0x7fd458159530 2023-08-31T00:27:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458143a40 con 0x7fd45815dc10 2023-08-31T00:27:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 0x7fd4580c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 0x7fd4580c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39216/0 (socket says 172.21.15.77:39216) 2023-08-31T00:27:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 -- 172.21.15.77:0/562380664 learned_addr learned my addr 172.21.15.77:0/562380664 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd457fff700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd458159530 0x7fd4581581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45d785700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dc10 0x7fd4580c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 -- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dc10 msgr2=0x7fd4580c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dc10 0x7fd4580c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 -- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd458159530 msgr2=0x7fd4581581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd458159530 0x7fd4581581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 -- 172.21.15.77:0/562380664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009d00 con 0x7fd4580c9ee0 2023-08-31T00:27:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45cf84700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 0x7fd4580c8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c490 tx=0x7fd44c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c00cea0 con 0x7fd4580c9ee0 2023-08-31T00:27:19.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd44c0053e0 con 0x7fd4580c9ee0 2023-08-31T00:27:19.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd458143d20 con 0x7fd4580c9ee0 2023-08-31T00:27:19.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c006ac0 con 0x7fd4580c9ee0 2023-08-31T00:27:19.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.683+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580c9040 con 0x7fd4580c9ee0 2023-08-31T00:27:19.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.684+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd458144240 con 0x7fd4580c9ee0 2023-08-31T00:27:19.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.685+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd44c003680 con 0x7fd4580c9ee0 2023-08-31T00:27:19.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.685+0000 7fd4557fa700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd43c06a0e0 0x7fd43c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:19.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.685+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd44c087800 con 0x7fd4580c9ee0 2023-08-31T00:27:19.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.685+0000 7fd457fff700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd43c06a0e0 0x7fd43c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:19.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.686+0000 7fd457fff700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd43c06a0e0 0x7fd43c06c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd45814ad70 tx=0x7fd44400b410 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:19.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.690+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd458144240 con 0x7fd4580c9ee0 2023-08-31T00:27:19.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.921+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4580c91d0 con 0x7fd4580c9ee0 2023-08-31T00:27:19.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.921+0000 7fd4557fa700 1 -- 172.21.15.77:0/562380664 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd44c052fe0 con 0x7fd4580c9ee0 2023-08-31T00:27:19.923 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T00:27:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd43c06a0e0 msgr2=0x7fd43c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd43c06a0e0 0x7fd43c06c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd45814ad70 tx=0x7fd44400b410 comp rx=0 tx=0).stop 2023-08-31T00:27:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 msgr2=0x7fd4580c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:19.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 0x7fd4580c8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c490 tx=0x7fd44c00c7a0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 shutdown_connections 2023-08-31T00:27:19.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd43c06a0e0 0x7fd43c06c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd45815dc10 0x7fd4580c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4580c9ee0 0x7fd4580c8b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 --2- 172.21.15.77:0/562380664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd458159530 0x7fd4581581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 >> 172.21.15.77:0/562380664 conn(0x7fd4580cf180 msgr2=0x7fd458154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 shutdown_connections 2023-08-31T00:27:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:19.923+0000 7fd45f1e8700 1 -- 172.21.15.77:0/562380664 wait complete. 2023-08-31T00:27:19.936 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T00:27:19.936 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T00:27:19.937 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2023-08-31T00:27:19.937 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-31T00:27:19.937 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:19.937 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T00:27:19.938 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T00:27:19.938 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T00:27:19.938 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T00:27:19.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:19.939 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2023-08-31T00:27:19.960 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:19.960 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:19.960 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:19.961 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:19.961 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:19.961 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:19.961 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:19.961 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:19.962 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:19.962 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:19.962 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:19.962 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:19.962 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T00:27:19.963 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:19.963 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T00:27:19.963 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42299sec preferred_lft 42299sec 2023-08-31T00:27:19.963 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::5557:1054:c7ab:1ba/64 scope link noprefixroute 2023-08-31T00:27:19.963 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:19.964 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T00:27:19.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:19.965 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:19.965 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:19.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2023-08-31T00:27:19.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2023-08-31T00:27:19.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2023-08-31T00:27:19.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T00:27:19.966 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:20.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.135 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T00:27:20.163 INFO:teuthology.orchestra.run.smithi139.stdout:1 2023-08-31T00:27:20.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.164 DEBUG:teuthology.orchestra.run.smithi139:> route 2023-08-31T00:27:20.233 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2023-08-31T00:27:20.233 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T00:27:20.233 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T00:27:20.234 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T00:27:20.234 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T00:27:20.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.235 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:20.235 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:20.235 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T00:27:20.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T00:27:20.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T00:27:20.237 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:20.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.469 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-08-31T00:27:20.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.486 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2023-08-31T00:27:20.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.543 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:20.543 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:20.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T00:27:20.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-31T00:27:20.544 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:20.636 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-31T00:27:20.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.637 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:20.637 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:20.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-31T00:27:20.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T00:27:20.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-31T00:27:20.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-31T00:27:20.639 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-31T00:27:20.639 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:20.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:20.855 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:20.855 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:20.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2023-08-31T00:27:20.856 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T00:27:20.856 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:20.955 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-31T00:27:20.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:20.956 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:20.976 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-31T00:27:20.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:20.977 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:21.033 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-08-31T00:27:21.100 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:21.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:21.167 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:21.167 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:21.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:21.169 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-08-31T00:27:21.225 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T00:27:21.226 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-31T00:27:21.268 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-08-31T00:27:21.294 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:21.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:21.362 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:21.363 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:21.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:21.364 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-08-31T00:27:21.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi139.stderr:2023-08-31T00:27:21.369+0000 7fb2be91d5c0 -1 init, newargv = 0x5611a32ef110 newargc=15 2023-08-31T00:27:21.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi139.stderr:ceph-fuse[110544]: starting ceph client 2023-08-31T00:27:21.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi139.stderr:ceph-fuse[110544]: starting fuse 2023-08-31T00:27:21.385 INFO:teuthology.orchestra.run.smithi139.stdout:46 2023-08-31T00:27:21.385 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-31T00:27:21.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo stdin-killer -- python3 -c ' 2023-08-31T00:27:21.386 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2023-08-31T00:27:21.386 DEBUG:teuthology.orchestra.run.smithi139:> import re 2023-08-31T00:27:21.387 DEBUG:teuthology.orchestra.run.smithi139:> import os 2023-08-31T00:27:21.387 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2023-08-31T00:27:21.387 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:21.388 DEBUG:teuthology.orchestra.run.smithi139:> def _find_admin_socket(client_name): 2023-08-31T00:27:21.388 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-31T00:27:21.388 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2023-08-31T00:27:21.389 DEBUG:teuthology.orchestra.run.smithi139:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-31T00:27:21.389 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:21.389 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2023-08-31T00:27:21.390 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2023-08-31T00:27:21.390 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2023-08-31T00:27:21.390 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2023-08-31T00:27:21.390 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:21.391 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2023-08-31T00:27:21.391 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T00:27:21.391 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T00:27:21.392 DEBUG:teuthology.orchestra.run.smithi139:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T00:27:21.392 DEBUG:teuthology.orchestra.run.smithi139:> contents = proc_f.read() 2023-08-31T00:27:21.392 DEBUG:teuthology.orchestra.run.smithi139:> if mountpoint in contents: 2023-08-31T00:27:21.393 DEBUG:teuthology.orchestra.run.smithi139:> return f 2023-08-31T00:27:21.393 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T00:27:21.393 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:21.394 DEBUG:teuthology.orchestra.run.smithi139:> print(_find_admin_socket("client.1")) 2023-08-31T00:27:21.394 DEBUG:teuthology.orchestra.run.smithi139:> ' 2023-08-31T00:27:21.508 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.1.110544.asok 2023-08-31T00:27:21.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:27:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T00:27:21.518 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.110544.asok 2023-08-31T00:27:21.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:21.519 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.110544.asok status 2023-08-31T00:27:21.673 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-08-31T00:27:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2023-08-31T00:27:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T00:27:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T00:27:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "1", 2023-08-31T00:27:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2023-08-31T00:27:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-31T00:27:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "110544", 2023-08-31T00:27:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2023-08-31T00:27:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2023-08-31T00:27:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2023-08-31T00:27:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4660, 2023-08-31T00:27:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2023-08-31T00:27:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2023-08-31T00:27:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2023-08-31T00:27:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 4660 2023-08-31T00:27:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2023-08-31T00:27:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-08-31T00:27:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2023-08-31T00:27:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2913065025 2023-08-31T00:27:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-08-31T00:27:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2023-08-31T00:27:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-08-31T00:27:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2023-08-31T00:27:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2913065025 2023-08-31T00:27:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.4660 192.168.0.1:0/2913065025", 2023-08-31T00:27:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "192.168.0.1:0/2913065025", 2023-08-31T00:27:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2023-08-31T00:27:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 8, 2023-08-31T00:27:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 20, 2023-08-31T00:27:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2023-08-31T00:27:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "blocklisted": false, 2023-08-31T00:27:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2023-08-31T00:27:21.682 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-08-31T00:27:21.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T00:27:21.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 -- 172.21.15.77:0/2260585856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 msgr2=0x7f47a0162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:21.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 --2- 172.21.15.77:0/2260585856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0162df0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4798009f60 tx=0x7f4798009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:21.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 -- 172.21.15.77:0/2260585856 shutdown_connections 2023-08-31T00:27:21.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 --2- 172.21.15.77:0/2260585856 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0162df0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:21.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 -- 172.21.15.77:0/2260585856 >> 172.21.15.77:0/2260585856 conn(0x7f47a0069d50 msgr2=0x7f47a006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:21.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 -- 172.21.15.77:0/2260585856 shutdown_connections 2023-08-31T00:27:21.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.820+0000 7f47a7d07700 1 -- 172.21.15.77:0/2260585856 wait complete. 2023-08-31T00:27:21.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.821+0000 7f47a7d07700 1 Processor -- start 2023-08-31T00:27:21.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.821+0000 7f47a7d07700 1 -- start start 2023-08-31T00:27:21.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:21.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47a00cd810 0x7f47a00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:21.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47a00c9890 0x7f47a0150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:21.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a00c9d20 con 0x7f47a006c4e0 2023-08-31T00:27:21.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01441a0 con 0x7f47a00cd810 2023-08-31T00:27:21.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0151bf0 con 0x7f47a00c9890 2023-08-31T00:27:21.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:21.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39230/0 (socket says 172.21.15.77:39230) 2023-08-31T00:27:21.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 -- 172.21.15.77:0/1730010728 learned_addr learned my addr 172.21.15.77:0/1730010728 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:21.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a62a4700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47a00c9890 0x7f47a0150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:21.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a52a2700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47a00cd810 0x7f47a00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:21.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 -- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47a00c9890 msgr2=0x7f47a0150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47a00c9890 0x7f47a0150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 -- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47a00cd810 msgr2=0x7f47a00c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47a00cd810 0x7f47a00c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 -- 172.21.15.77:0/1730010728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009c40 con 0x7f47a006c4e0 2023-08-31T00:27:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a52a2700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47a00cd810 0x7f47a00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a5aa3700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0143c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b470 tx=0x7f479c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:21.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c011830 con 0x7f47a006c4e0 2023-08-31T00:27:21.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f479c011a80 con 0x7f47a006c4e0 2023-08-31T00:27:21.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c011e90 con 0x7f47a006c4e0 2023-08-31T00:27:21.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.822+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a0151ed0 con 0x7f47a006c4e0 2023-08-31T00:27:21.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.823+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a00aaf00 con 0x7f47a006c4e0 2023-08-31T00:27:21.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.824+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a00ab120 con 0x7f47a006c4e0 2023-08-31T00:27:21.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.824+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f479c01a410 con 0x7f47a006c4e0 2023-08-31T00:27:21.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.824+0000 7f47967fc700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f478406a110 0x7f478406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:21.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.824+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f479c088210 con 0x7f47a006c4e0 2023-08-31T00:27:21.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.825+0000 7f47a52a2700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f478406a110 0x7f478406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.825+0000 7f47a52a2700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f478406a110 0x7f478406c5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47a00aab10 tx=0x7f4790009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:21.829+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f479c053950 con 0x7f47a006c4e0 2023-08-31T00:27:22.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.060+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f47a006bb30 con 0x7f47a006c4e0 2023-08-31T00:27:22.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.060+0000 7f47967fc700 1 -- 172.21.15.77:0/1730010728 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f479c056f70 con 0x7f47a006c4e0 2023-08-31T00:27:22.062 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T00:27:22.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f478406a110 msgr2=0x7f478406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f478406a110 0x7f478406c5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47a00aab10 tx=0x7f4790009040 comp rx=0 tx=0).stop 2023-08-31T00:27:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 msgr2=0x7f47a0143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0143c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f479c00b470 tx=0x7f479c00b830 comp rx=0 tx=0).stop 2023-08-31T00:27:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 shutdown_connections 2023-08-31T00:27:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f478406a110 0x7f478406c5d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47a00c9890 0x7f47a0150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47a006c4e0 0x7f47a0143c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 --2- 172.21.15.77:0/1730010728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47a00cd810 0x7f47a00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:22.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 >> 172.21.15.77:0/1730010728 conn(0x7f47a0069d50 msgr2=0x7f47a0152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:22.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 shutdown_connections 2023-08-31T00:27:22.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:22.062+0000 7f47a7d07700 1 -- 172.21.15.77:0/1730010728 wait complete. 2023-08-31T00:27:22.074 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T00:27:22.075 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T00:27:22.075 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2023-08-31T00:27:22.076 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-31T00:27:22.076 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:22.077 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T00:27:22.077 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T00:27:22.077 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T00:27:22.078 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-31T00:27:22.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.079 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2023-08-31T00:27:22.099 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:22.099 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:22.100 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:22.100 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.100 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:22.100 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.100 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:22.101 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:22.101 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:22.101 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:22.101 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:27:22.101 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:22.102 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T00:27:22.102 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:22.102 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T00:27:22.102 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-08-31T00:27:22.102 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::5557:1054:c7ab:1ba/64 scope link noprefixroute 2023-08-31T00:27:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.103 INFO:teuthology.orchestra.run.smithi139.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:27:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 8e:a1:d6:dd:0b:a4 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:27:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T00:27:22.103 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.104 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::868:80ff:fec3:a750/64 scope link 2023-08-31T00:27:22.104 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.104 INFO:teuthology.orchestra.run.smithi139.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T00:27:22.104 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 8e:a1:d6:dd:0b:a4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T00:27:22.104 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::8ca1:d6ff:fedd:ba4/64 scope link 2023-08-31T00:27:22.104 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.105 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T00:27:22.166 INFO:teuthology.orchestra.run.smithi139.stdout:1 2023-08-31T00:27:22.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.168 DEBUG:teuthology.orchestra.run.smithi139:> route 2023-08-31T00:27:22.227 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2023-08-31T00:27:22.227 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T00:27:22.227 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T00:27:22.229 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T00:27:22.229 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T00:27:22.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.230 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:22.230 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:22.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T00:27:22.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T00:27:22.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T00:27:22.232 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:22.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.333 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-08-31T00:27:22.350 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T00:27:22.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.352 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2023-08-31T00:27:22.408 INFO:teuthology.orchestra.run.smithi139.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-31T00:27:22.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.409 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:22.409 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:22.409 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T00:27:22.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-31T00:27:22.410 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:22.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T00:27:22.546 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:22.547 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:22.547 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:22.547 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.547 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:22.548 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.548 INFO:teuthology.orchestra.run.smithi139.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:27:22.548 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 8e:aa:5e:f4:6f:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T00:27:22.548 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T00:27:22.548 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.549 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::8caa:5eff:fef4:6f17/64 scope link 2023-08-31T00:27:22.549 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T00:27:22.598 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:27:22.598 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:27:22.598 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:27:22.599 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.599 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2023-08-31T00:27:22.599 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.599 INFO:teuthology.orchestra.run.smithi139.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:27:22.599 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 8e:aa:5e:f4:6f:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T00:27:22.600 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T00:27:22.600 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.600 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::8caa:5eff:fef4:6f17/64 scope link 2023-08-31T00:27:22.600 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:27:22.610 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-31T00:27:22.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.611 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:22.611 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:22.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-31T00:27:22.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T00:27:22.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-31T00:27:22.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-31T00:27:22.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-31T00:27:22.614 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:22.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:22.865 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-08-31T00:27:22.865 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-08-31T00:27:22.866 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.1 up 2023-08-31T00:27:22.866 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T00:27:22.866 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-08-31T00:27:22.974 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-08-31T00:27:22.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:22.975 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:22.995 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-31T00:27:22.995 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:27:22.996 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:23.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-08-31T00:27:23.118 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:23.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:23.184 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:23.185 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:23.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.186 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-08-31T00:27:23.242 INFO:teuthology.orchestra.run.smithi139.stdout:46 2023-08-31T00:27:23.243 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-08-31T00:27:23.243 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-08-31T00:27:23.285 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-08-31T00:27:23.311 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:27:23.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:27:23.372 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi139.stderr:2023-08-31T00:27:23.372+0000 7f0fa825f5c0 -1 init, newargv = 0x55653e063100 newargc=15 2023-08-31T00:27:23.373 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi139.stderr:ceph-fuse[111138]: starting ceph client 2023-08-31T00:27:23.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi139.stderr:ceph-fuse[111138]: starting fuse 2023-08-31T00:27:23.378 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:27:23.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:27:23.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.381 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-08-31T00:27:23.438 INFO:teuthology.orchestra.run.smithi139.stdout:46 2023-08-31T00:27:23.438 INFO:teuthology.orchestra.run.smithi139.stdout:48 2023-08-31T00:27:23.438 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-08-31T00:27:23.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo stdin-killer -- python3 -c ' 2023-08-31T00:27:23.439 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2023-08-31T00:27:23.440 DEBUG:teuthology.orchestra.run.smithi139:> import re 2023-08-31T00:27:23.440 DEBUG:teuthology.orchestra.run.smithi139:> import os 2023-08-31T00:27:23.440 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2023-08-31T00:27:23.441 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:23.441 DEBUG:teuthology.orchestra.run.smithi139:> def _find_admin_socket(client_name): 2023-08-31T00:27:23.442 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-08-31T00:27:23.442 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2023-08-31T00:27:23.442 DEBUG:teuthology.orchestra.run.smithi139:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-08-31T00:27:23.443 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:23.443 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2023-08-31T00:27:23.444 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2023-08-31T00:27:23.444 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2023-08-31T00:27:23.444 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2023-08-31T00:27:23.445 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:23.445 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2023-08-31T00:27:23.445 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T00:27:23.445 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T00:27:23.446 DEBUG:teuthology.orchestra.run.smithi139:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T00:27:23.446 DEBUG:teuthology.orchestra.run.smithi139:> contents = proc_f.read() 2023-08-31T00:27:23.446 DEBUG:teuthology.orchestra.run.smithi139:> if mountpoint in contents: 2023-08-31T00:27:23.447 DEBUG:teuthology.orchestra.run.smithi139:> return f 2023-08-31T00:27:23.447 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T00:27:23.447 DEBUG:teuthology.orchestra.run.smithi139:> 2023-08-31T00:27:23.448 DEBUG:teuthology.orchestra.run.smithi139:> print(_find_admin_socket("client.3")) 2023-08-31T00:27:23.448 DEBUG:teuthology.orchestra.run.smithi139:> ' 2023-08-31T00:27:23.562 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.3.111138.asok 2023-08-31T00:27:23.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-08-31T00:27:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T00:27:23.572 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.111138.asok 2023-08-31T00:27:23.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.111138.asok status 2023-08-31T00:27:23.727 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-08-31T00:27:23.728 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2023-08-31T00:27:23.728 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T00:27:23.728 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T00:27:23.728 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "3", 2023-08-31T00:27:23.728 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2023-08-31T00:27:23.729 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-08-31T00:27:23.729 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "111138", 2023-08-31T00:27:23.729 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2023-08-31T00:27:23.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:23.729 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2023-08-31T00:27:23.730 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2023-08-31T00:27:23.730 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4669, 2023-08-31T00:27:23.730 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2023-08-31T00:27:23.730 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2023-08-31T00:27:23.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2023-08-31T00:27:23.730 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 4669 2023-08-31T00:27:23.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:23.731 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2023-08-31T00:27:23.731 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-08-31T00:27:23.731 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.2:0", 2023-08-31T00:27:23.731 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2746210393 2023-08-31T00:27:23.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-08-31T00:27:23.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:23.732 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2023-08-31T00:27:23.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-08-31T00:27:23.732 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.2:0", 2023-08-31T00:27:23.732 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2746210393 2023-08-31T00:27:23.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-08-31T00:27:23.733 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.4669 192.168.0.2:0/2746210393", 2023-08-31T00:27:23.733 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "192.168.0.2:0/2746210393", 2023-08-31T00:27:23.733 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2023-08-31T00:27:23.734 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 8, 2023-08-31T00:27:23.734 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 20, 2023-08-31T00:27:23.734 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2023-08-31T00:27:23.734 INFO:teuthology.orchestra.run.smithi139.stdout: "blocklisted": false, 2023-08-31T00:27:23.735 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2023-08-31T00:27:23.735 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-08-31T00:27:23.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.738 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-08-31T00:27:23.738 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:23.760 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-08-31T00:27:23.761 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:23.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.762 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:23.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.835 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-08-31T00:27:23.835 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:23.897 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-08-31T00:27:23.897 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:23.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:23.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.971 DEBUG:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2023-08-31T00:27:23.971 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:23.988 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2023-08-31T00:27:23.989 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:23.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:23.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:24.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:24.055 DEBUG:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2023-08-31T00:27:24.055 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:24.111 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2023-08-31T00:27:24.112 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:24.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:24.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:24.178 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-31T00:27:24.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:24.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 -- 172.21.15.77:0/1362504441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 msgr2=0x7f22a40adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 --2- 172.21.15.77:0/1362504441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40adee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f22a406fd00 tx=0x7f2294009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:24.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 -- 172.21.15.77:0/1362504441 shutdown_connections 2023-08-31T00:27:24.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 --2- 172.21.15.77:0/1362504441 >> v2:172.21.15.139:3300/0 conn(0x7f22a40c9830 0x7f22a40c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 --2- 172.21.15.77:0/1362504441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40adee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 -- 172.21.15.77:0/1362504441 >> 172.21.15.77:0/1362504441 conn(0x7f22a40cd370 msgr2=0x7f22a40cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:24.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 -- 172.21.15.77:0/1362504441 shutdown_connections 2023-08-31T00:27:24.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.330+0000 7f22aa032700 1 -- 172.21.15.77:0/1362504441 wait complete. 2023-08-31T00:27:24.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 Processor -- start 2023-08-31T00:27:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 -- start start 2023-08-31T00:27:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a40668d0 0x7f22a4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a40c9830 0x7f22a40c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a41529b0 con 0x7f22a4158660 2023-08-31T00:27:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4152bc0 con 0x7f22a40668d0 2023-08-31T00:27:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.332+0000 7f22aa032700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4152e60 con 0x7f22a40c9830 2023-08-31T00:27:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39248/0 (socket says 172.21.15.77:39248) 2023-08-31T00:27:24.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 -- 172.21.15.77:0/3157516817 learned_addr learned my addr 172.21.15.77:0/3157516817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a37fe700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a40668d0 0x7f22a4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a2ffd700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a40c9830 0x7f22a40c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 -- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a40c9830 msgr2=0x7f22a40c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a40c9830 0x7f22a40c0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 -- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a40668d0 msgr2=0x7f22a4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a40668d0 0x7f22a4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 -- 172.21.15.77:0/3157516817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940095f0 con 0x7f22a4158660 2023-08-31T00:27:24.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a37fe700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a40668d0 0x7f22a4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:24.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22a3fff700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40c5f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f229c00efc0 tx=0x7f229c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:24.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c018070 con 0x7f22a4158660 2023-08-31T00:27:24.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f229c00f040 con 0x7f22a4158660 2023-08-31T00:27:24.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a4153140 con 0x7f22a4158660 2023-08-31T00:27:24.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c004bb0 con 0x7f22a4158660 2023-08-31T00:27:24.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.333+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a406cff0 con 0x7f22a4158660 2023-08-31T00:27:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.334+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a40ccd90 con 0x7f22a4158660 2023-08-31T00:27:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.335+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f229c004d10 con 0x7f22a4158660 2023-08-31T00:27:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.335+0000 7f228bfff700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f229006a0e0 0x7f229006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.335+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f229c088340 con 0x7f22a4158660 2023-08-31T00:27:24.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.335+0000 7f22a37fe700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f229006a0e0 0x7f229006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.335+0000 7f22a37fe700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f229006a0e0 0x7f229006c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2294000c00 tx=0x7f22940047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:24.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.340+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f229c053bb0 con 0x7f22a4158660 2023-08-31T00:27:24.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.530+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22a4153660 con 0x7f22a4158660 2023-08-31T00:27:24.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.532+0000 7f228bfff700 1 -- 172.21.15.77:0/3157516817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f22a4153660 con 0x7f22a4158660 2023-08-31T00:27:24.533 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:24.533 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:24.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f229006a0e0 msgr2=0x7f229006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f229006a0e0 0x7f229006c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2294000c00 tx=0x7f22940047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 msgr2=0x7f22a40c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40c5f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f229c00efc0 tx=0x7f229c00c3a0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 shutdown_connections 2023-08-31T00:27:24.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f229006a0e0 0x7f229006c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22a4158660 0x7f22a40c5f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22a40668d0 0x7f22a4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 --2- 172.21.15.77:0/3157516817 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22a40c9830 0x7f22a40c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 >> 172.21.15.77:0/3157516817 conn(0x7f22a40cd370 msgr2=0x7f22a4154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:24.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 shutdown_connections 2023-08-31T00:27:24.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.534+0000 7f22aa032700 1 -- 172.21.15.77:0/3157516817 wait complete. 2023-08-31T00:27:24.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:24.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:24.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 -- 172.21.15.77:0/1182096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef6c004850 msgr2=0x7fef6c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 --2- 172.21.15.77:0/1182096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef6c004850 0x7fef6c004cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fef7000c310 tx=0x7fef6c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 -- 172.21.15.77:0/1182096130 shutdown_connections 2023-08-31T00:27:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 --2- 172.21.15.77:0/1182096130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef6c004850 0x7fef6c004cd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 -- 172.21.15.77:0/1182096130 >> 172.21.15.77:0/1182096130 conn(0x7fef800cf180 msgr2=0x7fef800cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:24.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 -- 172.21.15.77:0/1182096130 shutdown_connections 2023-08-31T00:27:24.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.673+0000 7fef8611f700 1 -- 172.21.15.77:0/1182096130 wait complete. 2023-08-31T00:27:24.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.674+0000 7fef8611f700 1 Processor -- start 2023-08-31T00:27:24.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.674+0000 7fef8611f700 1 -- start start 2023-08-31T00:27:24.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef8611f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef6c004850 0x7fef800c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef8611f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 0x7fef8015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef8611f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef8015c0d0 0x7fef800b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef8611f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015c550 con 0x7fef80154d20 2023-08-31T00:27:24.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef8611f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8006c680 con 0x7fef6c004850 2023-08-31T00:27:24.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef8611f700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b1e90 con 0x7fef8015c0d0 2023-08-31T00:27:24.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 0x7fef8015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 0x7fef8015bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39266/0 (socket says 172.21.15.77:39266) 2023-08-31T00:27:24.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 -- 172.21.15.77:0/2950006855 learned_addr learned my addr 172.21.15.77:0/2950006855 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:24.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7f7fe700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef6c004850 0x7fef800c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7ffff700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef8015c0d0 0x7fef800b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 -- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef8015c0d0 msgr2=0x7fef800b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef8015c0d0 0x7fef800b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 -- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef6c004850 msgr2=0x7fef800c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef6c004850 0x7fef800c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 -- 172.21.15.77:0/2950006855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b2130 con 0x7fef80154d20 2023-08-31T00:27:24.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7f7fe700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef6c004850 0x7fef800c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:24.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef7effd700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 0x7fef8015bb90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef70001930 tx=0x7fef70006730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:24.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.675+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70001630 con 0x7fef80154d20 2023-08-31T00:27:24.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.676+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef70003680 con 0x7fef80154d20 2023-08-31T00:27:24.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.676+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef800b2410 con 0x7fef80154d20 2023-08-31T00:27:24.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.676+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70003a90 con 0x7fef80154d20 2023-08-31T00:27:24.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.676+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef801551a0 con 0x7fef80154d20 2023-08-31T00:27:24.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.676+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80073c30 con 0x7fef80154d20 2023-08-31T00:27:24.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.677+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef70021020 con 0x7fef80154d20 2023-08-31T00:27:24.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.677+0000 7fef77fff700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef6006a110 0x7fef6006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:24.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.677+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef70089c20 con 0x7fef80154d20 2023-08-31T00:27:24.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.677+0000 7fef7f7fe700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef6006a110 0x7fef6006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:24.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.678+0000 7fef7f7fe700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef6006a110 0x7fef6006c5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef68000c00 tx=0x7fef68006bf0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:24.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.682+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fef70055410 con 0x7fef80154d20 2023-08-31T00:27:24.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.869+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef800cff90 con 0x7fef80154d20 2023-08-31T00:27:24.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.869+0000 7fef77fff700 1 -- 172.21.15.77:0/2950006855 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef700290a0 con 0x7fef80154d20 2023-08-31T00:27:24.871 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:24.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef6006a110 msgr2=0x7fef6006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef6006a110 0x7fef6006c5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fef68000c00 tx=0x7fef68006bf0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 msgr2=0x7fef8015bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:24.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 0x7fef8015bb90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fef70001930 tx=0x7fef70006730 comp rx=0 tx=0).stop 2023-08-31T00:27:24.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 shutdown_connections 2023-08-31T00:27:24.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef6006a110 0x7fef6006c5d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef8015c0d0 0x7fef800b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef6c004850 0x7fef800c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 --2- 172.21.15.77:0/2950006855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef80154d20 0x7fef8015bb90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:24.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 >> 172.21.15.77:0/2950006855 conn(0x7fef800cf180 msgr2=0x7fef801e4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:24.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 shutdown_connections 2023-08-31T00:27:24.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:24.871+0000 7fef8611f700 1 -- 172.21.15.77:0/2950006855 wait complete. 2023-08-31T00:27:24.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:25.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 -- 172.21.15.77:0/789917878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240caca0 msgr2=0x7fef241598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 --2- 172.21.15.77:0/789917878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240caca0 0x7fef241598f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef2406d970 tx=0x7fef18009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 -- 172.21.15.77:0/789917878 shutdown_connections 2023-08-31T00:27:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 --2- 172.21.15.77:0/789917878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240caca0 0x7fef241598f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 --2- 172.21.15.77:0/789917878 >> v2:172.21.15.139:3300/0 conn(0x7fef240cb080 0x7fef240cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 -- 172.21.15.77:0/789917878 >> 172.21.15.77:0/789917878 conn(0x7fef2406cbf0 msgr2=0x7fef2406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:25.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 -- 172.21.15.77:0/789917878 shutdown_connections 2023-08-31T00:27:25.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.008+0000 7fef2b21e700 1 -- 172.21.15.77:0/789917878 wait complete. 2023-08-31T00:27:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.009+0000 7fef2b21e700 1 Processor -- start 2023-08-31T00:27:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.009+0000 7fef2b21e700 1 -- start start 2023-08-31T00:27:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef2b21e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef24069b10 0x7fef240c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef2b21e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef240caca0 0x7fef241e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef2b21e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 0x7fef241e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef2b21e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240c2be0 con 0x7fef240cb080 2023-08-31T00:27:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef2b21e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef240b0b30 con 0x7fef240caca0 2023-08-31T00:27:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef2b21e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240c2060 con 0x7fef24069b10 2023-08-31T00:27:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef297bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 0x7fef241e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef297bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 0x7fef241e4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39280/0 (socket says 172.21.15.77:39280) 2023-08-31T00:27:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef297bb700 1 -- 172.21.15.77:0/2387520113 learned_addr learned my addr 172.21.15.77:0/2387520113 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.010+0000 7fef23fff700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef240caca0 0x7fef241e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef28fba700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef24069b10 0x7fef240c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef297bb700 1 -- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef24069b10 msgr2=0x7fef240c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef297bb700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef24069b10 0x7fef240c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef297bb700 1 -- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef240caca0 msgr2=0x7fef241e3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef297bb700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef240caca0 0x7fef241e3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef297bb700 1 -- 172.21.15.77:0/2387520113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180095f0 con 0x7fef240cb080 2023-08-31T00:27:25.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef297bb700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 0x7fef241e4290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00cc10 tx=0x7fef1c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:25.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00aa60 con 0x7fef240cb080 2023-08-31T00:27:25.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef240c2340 con 0x7fef240cb080 2023-08-31T00:27:25.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef1c00abc0 con 0x7fef240cb080 2023-08-31T00:27:25.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef240c2900 con 0x7fef240cb080 2023-08-31T00:27:25.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.011+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c01c460 con 0x7fef240cb080 2023-08-31T00:27:25.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.012+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef040052f0 con 0x7fef240cb080 2023-08-31T00:27:25.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.012+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef1c012420 con 0x7fef240cb080 2023-08-31T00:27:25.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.013+0000 7fef217fa700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef0806a0e0 0x7fef0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.013+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef1c088890 con 0x7fef240cb080 2023-08-31T00:27:25.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.013+0000 7fef28fba700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef0806a0e0 0x7fef0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.013+0000 7fef28fba700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef0806a0e0 0x7fef0806c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef18000c00 tx=0x7fef180047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:25.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.017+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fef1c054080 con 0x7fef240cb080 2023-08-31T00:27:25.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.206+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef04005b20 con 0x7fef240cb080 2023-08-31T00:27:25.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.207+0000 7fef217fa700 1 -- 172.21.15.77:0/2387520113 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef1c0576a0 con 0x7fef240cb080 2023-08-31T00:27:25.208 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:25.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef0806a0e0 msgr2=0x7fef0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef0806a0e0 0x7fef0806c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef18000c00 tx=0x7fef180047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 msgr2=0x7fef241e4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 0x7fef241e4290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00cc10 tx=0x7fef1c00cf20 comp rx=0 tx=0).stop 2023-08-31T00:27:25.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 shutdown_connections 2023-08-31T00:27:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fef0806a0e0 0x7fef0806c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fef24069b10 0x7fef240c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef240cb080 0x7fef241e4290 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 --2- 172.21.15.77:0/2387520113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef240caca0 0x7fef241e3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 >> 172.21.15.77:0/2387520113 conn(0x7fef2406cbf0 msgr2=0x7fef24157480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:25.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 shutdown_connections 2023-08-31T00:27:25.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.209+0000 7fef2b21e700 1 -- 172.21.15.77:0/2387520113 wait complete. 2023-08-31T00:27:25.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 -- 172.21.15.77:0/2598559670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 msgr2=0x7fe0e4159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/2598559670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e4159910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0005fd0 tx=0x7fe0e0009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 -- 172.21.15.77:0/2598559670 shutdown_connections 2023-08-31T00:27:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/2598559670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e4159910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 -- 172.21.15.77:0/2598559670 >> 172.21.15.77:0/2598559670 conn(0x7fe0e40cf180 msgr2=0x7fe0e40cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 -- 172.21.15.77:0/2598559670 shutdown_connections 2023-08-31T00:27:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.346+0000 7fe0ec60a700 1 -- 172.21.15.77:0/2598559670 wait complete. 2023-08-31T00:27:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.347+0000 7fe0ec60a700 1 Processor -- start 2023-08-31T00:27:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.347+0000 7fe0ec60a700 1 -- start start 2023-08-31T00:27:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e40c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0e4159530 0x7fe0e415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0e415dc10 0x7fe0e415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415b3c0 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40c1b90 con 0x7fe0e415dc10 2023-08-31T00:27:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415b0e0 con 0x7fe0e4159530 2023-08-31T00:27:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e40c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e40c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39290/0 (socket says 172.21.15.77:39290) 2023-08-31T00:27:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 -- 172.21.15.77:0/1344551011 learned_addr learned my addr 172.21.15.77:0/1344551011 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 -- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0e4159530 msgr2=0x7fe0e415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0eaba7700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0e415dc10 0x7fe0e415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0e9ba5700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0e4159530 0x7fe0e415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0e4159530 0x7fe0e415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 -- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0e415dc10 msgr2=0x7fe0e415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0e415dc10 0x7fe0e415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 -- 172.21.15.77:0/1344551011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e00095f0 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0eaba7700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0e415dc10 0x7fe0e415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0e9ba5700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0e4159530 0x7fe0e415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ea3a6700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e40c1650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400c4d0 tx=0x7fe0d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4011790 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe0d40119e0 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e41f56c0 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4011df0 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.348+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e41f5c80 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.349+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e41f5520 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.350+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe0d401c460 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.350+0000 7fe0daffd700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe0c806a0e0 0x7fe0c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.350+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0d40884d0 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.350+0000 7fe0e9ba5700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe0c806a0e0 0x7fe0c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.350+0000 7fe0e9ba5700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe0c806a0e0 0x7fe0c806c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0e41432c0 tx=0x7fe0e00047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:25.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.354+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe0e41f5520 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.548+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0e41f5520 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.549+0000 7fe0daffd700 1 -- 172.21.15.77:0/1344551011 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0e41f5520 con 0x7fe0e40c9ee0 2023-08-31T00:27:25.550 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe0c806a0e0 msgr2=0x7fe0c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe0c806a0e0 0x7fe0c806c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0e41432c0 tx=0x7fe0e00047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 msgr2=0x7fe0e40c1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e40c1650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400c4d0 tx=0x7fe0d400c890 comp rx=0 tx=0).stop 2023-08-31T00:27:25.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 shutdown_connections 2023-08-31T00:27:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe0c806a0e0 0x7fe0c806c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0e415dc10 0x7fe0e415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0e40c9ee0 0x7fe0e40c1650 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 --2- 172.21.15.77:0/1344551011 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe0e4159530 0x7fe0e415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 >> 172.21.15.77:0/1344551011 conn(0x7fe0e40cf180 msgr2=0x7fe0e4159910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 shutdown_connections 2023-08-31T00:27:25.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.551+0000 7fe0ec60a700 1 -- 172.21.15.77:0/1344551011 wait complete. 2023-08-31T00:27:25.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:25.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 -- 172.21.15.77:0/3440404015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15280cc640 msgr2=0x7f15280aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 --2- 172.21.15.77:0/3440404015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15280cc640 0x7f15280aca00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1518005fd0 tx=0x7f1518009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:25.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 -- 172.21.15.77:0/3440404015 shutdown_connections 2023-08-31T00:27:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 --2- 172.21.15.77:0/3440404015 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152806ab20 0x7f152806af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 --2- 172.21.15.77:0/3440404015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15280cc640 0x7f15280aca00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 -- 172.21.15.77:0/3440404015 >> 172.21.15.77:0/3440404015 conn(0x7f1528070270 msgr2=0x7f1528070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 -- 172.21.15.77:0/3440404015 shutdown_connections 2023-08-31T00:27:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.685+0000 7f152cd36700 1 -- 172.21.15.77:0/3440404015 wait complete. 2023-08-31T00:27:25.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.686+0000 7f152cd36700 1 Processor -- start 2023-08-31T00:27:25.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.686+0000 7f152cd36700 1 -- start start 2023-08-31T00:27:25.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152cd36700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 0x7f15280c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152cd36700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15280cc640 0x7f1528155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152cd36700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152815bb70 0x7f1528159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152cd36700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280c6950 con 0x7f152806ab20 2023-08-31T00:27:25.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152cd36700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15280aabc0 con 0x7f15280cc640 2023-08-31T00:27:25.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152cd36700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15280c5cd0 con 0x7f152815bb70 2023-08-31T00:27:25.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 0x7f15280c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 0x7f15280c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39304/0 (socket says 172.21.15.77:39304) 2023-08-31T00:27:25.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 -- 172.21.15.77:0/2459890497 learned_addr learned my addr 172.21.15.77:0/2459890497 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:25.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f1525d9b700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15280cc640 0x7f1528155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f1526d9d700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152815bb70 0x7f1528159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 -- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152815bb70 msgr2=0x7f1528159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152815bb70 0x7f1528159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 -- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15280cc640 msgr2=0x7f1528155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15280cc640 0x7f1528155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 -- 172.21.15.77:0/2459890497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180095f0 con 0x7f152806ab20 2023-08-31T00:27:25.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f1526d9d700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152815bb70 0x7f1528159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:25.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f152659c700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 0x7f15280c1d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f151c00b530 tx=0x7f151c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:25.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c011830 con 0x7f152806ab20 2023-08-31T00:27:25.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.687+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f151c011a80 con 0x7f152806ab20 2023-08-31T00:27:25.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.688+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15280c5fb0 con 0x7f152806ab20 2023-08-31T00:27:25.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.688+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c011e70 con 0x7f152806ab20 2023-08-31T00:27:25.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.688+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15280c6570 con 0x7f152806ab20 2023-08-31T00:27:25.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.689+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528073c30 con 0x7f152806ab20 2023-08-31T00:27:25.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.689+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f151c01a400 con 0x7f152806ab20 2023-08-31T00:27:25.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.689+0000 7f1516ffd700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f150806a0e0 0x7f150806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:25.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.689+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f151c088720 con 0x7f152806ab20 2023-08-31T00:27:25.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.689+0000 7f1525d9b700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f150806a0e0 0x7f150806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:25.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.690+0000 7f1525d9b700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f150806a0e0 0x7f150806c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1518000c00 tx=0x7f15180047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:25.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.694+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f151c053ef0 con 0x7f152806ab20 2023-08-31T00:27:25.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.885+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1528071250 con 0x7f152806ab20 2023-08-31T00:27:25.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.886+0000 7f1516ffd700 1 -- 172.21.15.77:0/2459890497 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f151c01e1b0 con 0x7f152806ab20 2023-08-31T00:27:25.887 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:25.888 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:25.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.888+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f150806a0e0 msgr2=0x7f150806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.888+0000 7f152cd36700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f150806a0e0 0x7f150806c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1518000c00 tx=0x7f15180047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.888+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 msgr2=0x7f15280c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:25.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.888+0000 7f152cd36700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 0x7f15280c1d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f151c00b530 tx=0x7f151c00b840 comp rx=0 tx=0).stop 2023-08-31T00:27:25.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 shutdown_connections 2023-08-31T00:27:25.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f150806a0e0 0x7f150806c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f152815bb70 0x7f1528159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f152806ab20 0x7f15280c1d40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 --2- 172.21.15.77:0/2459890497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15280cc640 0x7f1528155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 >> 172.21.15.77:0/2459890497 conn(0x7f1528070270 msgr2=0x7f15280b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 shutdown_connections 2023-08-31T00:27:25.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:25.889+0000 7f152cd36700 1 -- 172.21.15.77:0/2459890497 wait complete. 2023-08-31T00:27:25.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:25.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 -- 172.21.15.77:0/171475592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb640071000 msgr2=0x7fb6400c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 --2- 172.21.15.77:0/171475592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb640071000 0x7fb6400c96b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb638009fd0 tx=0x7fb63800b380 comp rx=0 tx=0).stop 2023-08-31T00:27:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 -- 172.21.15.77:0/171475592 shutdown_connections 2023-08-31T00:27:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 --2- 172.21.15.77:0/171475592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb640071000 0x7fb6400c96b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 --2- 172.21.15.77:0/171475592 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb64006f130 0x7fb640070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 -- 172.21.15.77:0/171475592 >> 172.21.15.77:0/171475592 conn(0x7fb64006cbf0 msgr2=0x7fb64006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 -- 172.21.15.77:0/171475592 shutdown_connections 2023-08-31T00:27:26.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.026+0000 7fb647108700 1 -- 172.21.15.77:0/171475592 wait complete. 2023-08-31T00:27:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.027+0000 7fb647108700 1 Processor -- start 2023-08-31T00:27:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.027+0000 7fb647108700 1 -- start start 2023-08-31T00:27:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb647108700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb64006f130 0x7fb640144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb647108700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb640071000 0x7fb640154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb647108700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 0x7fb640154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb647108700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401448d0 con 0x7fb6401580f0 2023-08-31T00:27:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb647108700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401f01d0 con 0x7fb64006f130 2023-08-31T00:27:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb647108700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401ef5c0 con 0x7fb640071000 2023-08-31T00:27:26.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb6456a5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 0x7fb640154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb6456a5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 0x7fb640154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39320/0 (socket says 172.21.15.77:39320) 2023-08-31T00:27:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.028+0000 7fb6456a5700 1 -- 172.21.15.77:0/2937589687 learned_addr learned my addr 172.21.15.77:0/2937589687 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb63ffff700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb640071000 0x7fb640154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb644ea4700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb64006f130 0x7fb640144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb6456a5700 1 -- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb640071000 msgr2=0x7fb640154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb6456a5700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb640071000 0x7fb640154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb6456a5700 1 -- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb64006f130 msgr2=0x7fb640144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb6456a5700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb64006f130 0x7fb640144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb6456a5700 1 -- 172.21.15.77:0/2937589687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb638009d00 con 0x7fb6401580f0 2023-08-31T00:27:26.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb63ffff700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb640071000 0x7fb640154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb644ea4700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb64006f130 0x7fb640144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb6456a5700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 0x7fb640154ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb64006c500 tx=0x7fb638009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800e050 con 0x7fb6401580f0 2023-08-31T00:27:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb638008bf0 con 0x7fb6401580f0 2023-08-31T00:27:26.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6401ef8a0 con 0x7fb6401580f0 2023-08-31T00:27:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638004030 con 0x7fb6401580f0 2023-08-31T00:27:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.029+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6401efe60 con 0x7fb6401580f0 2023-08-31T00:27:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.030+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb640073c30 con 0x7fb6401580f0 2023-08-31T00:27:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.030+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb638019040 con 0x7fb6401580f0 2023-08-31T00:27:26.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.031+0000 7fb63d7fa700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb62406a0e0 0x7fb62406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.031+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6380898c0 con 0x7fb6401580f0 2023-08-31T00:27:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.031+0000 7fb644ea4700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb62406a0e0 0x7fb62406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.031+0000 7fb644ea4700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb62406a0e0 0x7fb62406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.035+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb638055090 con 0x7fb6401580f0 2023-08-31T00:27:26.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.226+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6401f0020 con 0x7fb6401580f0 2023-08-31T00:27:26.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.226+0000 7fb63d7fa700 1 -- 172.21.15.77:0/2937589687 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb638089070 con 0x7fb6401580f0 2023-08-31T00:27:26.228 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:26.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb62406a0e0 msgr2=0x7fb62406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb62406a0e0 0x7fb62406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb634006fd0 tx=0x7fb634008040 comp rx=0 tx=0).stop 2023-08-31T00:27:26.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 msgr2=0x7fb640154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 0x7fb640154ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb64006c500 tx=0x7fb638009450 comp rx=0 tx=0).stop 2023-08-31T00:27:26.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 shutdown_connections 2023-08-31T00:27:26.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb62406a0e0 0x7fb62406c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6401580f0 0x7fb640154ff0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb64006f130 0x7fb640144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 --2- 172.21.15.77:0/2937589687 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb640071000 0x7fb640154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.228+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 >> 172.21.15.77:0/2937589687 conn(0x7fb64006cbf0 msgr2=0x7fb640154310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:26.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.229+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 shutdown_connections 2023-08-31T00:27:26.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.229+0000 7fb647108700 1 -- 172.21.15.77:0/2937589687 wait complete. 2023-08-31T00:27:26.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:26.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.366+0000 7f08586a8700 1 -- 172.21.15.77:0/1254982436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f083c003a30 msgr2=0x7f083c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.366+0000 7f08586a8700 1 --2- 172.21.15.77:0/1254982436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f083c003a30 0x7f083c003e50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f084c00bb90 tx=0x7f083c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.366+0000 7f0856c45700 1 -- 172.21.15.77:0/1254982436 reap_dead start 2023-08-31T00:27:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.367+0000 7f08586a8700 1 -- 172.21.15.77:0/1254982436 shutdown_connections 2023-08-31T00:27:26.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.367+0000 7f08586a8700 1 -- 172.21.15.77:0/1254982436 >> 172.21.15.77:0/1254982436 conn(0x7f0850070270 msgr2=0x7f0850070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.367+0000 7f08586a8700 1 -- 172.21.15.77:0/1254982436 shutdown_connections 2023-08-31T00:27:26.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.367+0000 7f08586a8700 1 -- 172.21.15.77:0/1254982436 wait complete. 2023-08-31T00:27:26.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 Processor -- start 2023-08-31T00:27:26.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 -- start start 2023-08-31T00:27:26.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c003a30 0x7f085014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f08500abbf0 0x7f08500ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 0x7f08500b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b3460 con 0x7f08500b1b20 2023-08-31T00:27:26.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500ac5b0 con 0x7f083c003a30 2023-08-31T00:27:26.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.368+0000 7f08586a8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b28e0 con 0x7f08500abbf0 2023-08-31T00:27:26.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 0x7f08500b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 0x7f08500b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39340/0 (socket says 172.21.15.77:39340) 2023-08-31T00:27:26.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 -- 172.21.15.77:0/2940454310 learned_addr learned my addr 172.21.15.77:0/2940454310 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:26.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856444700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c003a30 0x7f085014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0855c43700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f08500abbf0 0x7f08500ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 -- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f08500abbf0 msgr2=0x7f08500ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f08500abbf0 0x7f08500ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 -- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c003a30 msgr2=0x7f085014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c003a30 0x7f085014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 -- 172.21.15.77:0/2940454310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500b2bc0 con 0x7f08500b1b20 2023-08-31T00:27:26.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0855c43700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f08500abbf0 0x7f08500ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:26.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0856c45700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 0x7f08500b1fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0848001330 tx=0x7f084800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:26.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848010890 con 0x7f08500b1b20 2023-08-31T00:27:26.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0848010b00 con 0x7f08500b1b20 2023-08-31T00:27:26.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08500b2ea0 con 0x7f08500b1b20 2023-08-31T00:27:26.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848011460 con 0x7f08500b1b20 2023-08-31T00:27:26.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.369+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08500b24f0 con 0x7f08500b1b20 2023-08-31T00:27:26.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.370+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085006c870 con 0x7f08500b1b20 2023-08-31T00:27:26.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.371+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08480193b0 con 0x7f08500b1b20 2023-08-31T00:27:26.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.371+0000 7f0846ffd700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f083406a0e0 0x7f083406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.371+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0848088b00 con 0x7f08500b1b20 2023-08-31T00:27:26.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.371+0000 7f0856444700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f083406a0e0 0x7f083406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.371+0000 7f0856444700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f083406a0e0 0x7f083406c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f084c012040 tx=0x7f084c01d040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:26.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.375+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f08480542e0 con 0x7f08500b1b20 2023-08-31T00:27:26.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.567+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08500cbe90 con 0x7f08500b1b20 2023-08-31T00:27:26.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.567+0000 7f0846ffd700 1 -- 172.21.15.77:0/2940454310 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08480150a0 con 0x7f08500b1b20 2023-08-31T00:27:26.569 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:26.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f083406a0e0 msgr2=0x7f083406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f083406a0e0 0x7f083406c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f084c012040 tx=0x7f084c01d040 comp rx=0 tx=0).stop 2023-08-31T00:27:26.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 msgr2=0x7f08500b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 0x7f08500b1fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0848001330 tx=0x7f084800eb60 comp rx=0 tx=0).stop 2023-08-31T00:27:26.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 shutdown_connections 2023-08-31T00:27:26.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f083406a0e0 0x7f083406c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08500b1b20 0x7f08500b1fb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c003a30 0x7f085014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.569+0000 7f08586a8700 1 --2- 172.21.15.77:0/2940454310 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f08500abbf0 0x7f08500ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.570+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 >> 172.21.15.77:0/2940454310 conn(0x7f0850070270 msgr2=0x7f08500cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:26.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.570+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 shutdown_connections 2023-08-31T00:27:26.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.570+0000 7f08586a8700 1 -- 172.21.15.77:0/2940454310 wait complete. 2023-08-31T00:27:26.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:26.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 -- 172.21.15.77:0/349723050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2015bce0 msgr2=0x7faf2015c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 --2- 172.21.15.77:0/349723050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2015bce0 0x7faf2015c140 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf200722d0 tx=0x7faf1800b380 comp rx=0 tx=0).stop 2023-08-31T00:27:26.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 -- 172.21.15.77:0/349723050 shutdown_connections 2023-08-31T00:27:26.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 --2- 172.21.15.77:0/349723050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2015bce0 0x7faf2015c140 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 --2- 172.21.15.77:0/349723050 >> v2:172.21.15.139:3300/0 conn(0x7faf20158210 0x7faf200c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 --2- 172.21.15.77:0/349723050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf2006e3c0 0x7faf2006e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 -- 172.21.15.77:0/349723050 >> 172.21.15.77:0/349723050 conn(0x7faf200afbf0 msgr2=0x7faf200b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:26.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 -- 172.21.15.77:0/349723050 shutdown_connections 2023-08-31T00:27:26.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.707+0000 7faf27405700 1 -- 172.21.15.77:0/349723050 wait complete. 2023-08-31T00:27:26.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.708+0000 7faf27405700 1 Processor -- start 2023-08-31T00:27:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.708+0000 7faf27405700 1 -- start start 2023-08-31T00:27:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf27405700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf2006e3c0 0x7faf200c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf27405700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 0x7faf201590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf27405700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf2015bce0 0x7faf2014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf27405700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2014d990 con 0x7faf20158210 2023-08-31T00:27:26.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf27405700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf20159610 con 0x7faf2006e3c0 2023-08-31T00:27:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf27405700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200c77b0 con 0x7faf2015bce0 2023-08-31T00:27:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf249a0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 0x7faf201590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf249a0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 0x7faf201590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39352/0 (socket says 172.21.15.77:39352) 2023-08-31T00:27:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf249a0700 1 -- 172.21.15.77:0/2782720493 learned_addr learned my addr 172.21.15.77:0/2782720493 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:26.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf251a1700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf2006e3c0 0x7faf200c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.709+0000 7faf259a2700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf2015bce0 0x7faf2014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf249a0700 1 -- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf2015bce0 msgr2=0x7faf2014c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf249a0700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf2015bce0 0x7faf2014c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf249a0700 1 -- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf2006e3c0 msgr2=0x7faf200c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf249a0700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf2006e3c0 0x7faf200c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf249a0700 1 -- 172.21.15.77:0/2782720493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009d00 con 0x7faf20158210 2023-08-31T00:27:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf249a0700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 0x7faf201590d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf1000c950 tx=0x7faf1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000e880 con 0x7faf20158210 2023-08-31T00:27:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf1000ead0 con 0x7faf20158210 2023-08-31T00:27:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf200c71f0 con 0x7faf20158210 2023-08-31T00:27:26.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000eea0 con 0x7faf20158210 2023-08-31T00:27:26.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.710+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf201588d0 con 0x7faf20158210 2023-08-31T00:27:26.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.711+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf200c49c0 con 0x7faf20158210 2023-08-31T00:27:26.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.711+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf1000f450 con 0x7faf20158210 2023-08-31T00:27:26.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.712+0000 7faf15ffb700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf0406a0e0 0x7faf0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:26.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.712+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf100888c0 con 0x7faf20158210 2023-08-31T00:27:26.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.712+0000 7faf251a1700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf0406a0e0 0x7faf0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:26.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.712+0000 7faf251a1700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf0406a0e0 0x7faf0406c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00abd0 tx=0x7faf1c00a380 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:26.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.716+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf10054130 con 0x7faf20158210 2023-08-31T00:27:26.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.903+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf20073c30 con 0x7faf20158210 2023-08-31T00:27:26.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.903+0000 7faf15ffb700 1 -- 172.21.15.77:0/2782720493 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf10014210 con 0x7faf20158210 2023-08-31T00:27:26.905 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:26.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf0406a0e0 msgr2=0x7faf0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf0406a0e0 0x7faf0406c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00abd0 tx=0x7faf1c00a380 comp rx=0 tx=0).stop 2023-08-31T00:27:26.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 msgr2=0x7faf201590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:26.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 0x7faf201590d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf1000c950 tx=0x7faf1000cc60 comp rx=0 tx=0).stop 2023-08-31T00:27:26.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 shutdown_connections 2023-08-31T00:27:26.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf0406a0e0 0x7faf0406c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf2015bce0 0x7faf2014c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf2006e3c0 0x7faf200c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 --2- 172.21.15.77:0/2782720493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf20158210 0x7faf201590d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:26.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.905+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 >> 172.21.15.77:0/2782720493 conn(0x7faf200afbf0 msgr2=0x7faf200c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:26.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.906+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 shutdown_connections 2023-08-31T00:27:26.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:26.906+0000 7faf27405700 1 -- 172.21.15.77:0/2782720493 wait complete. 2023-08-31T00:27:26.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:27.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:27:27.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:27:27.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.044+0000 7fc966f23700 1 -- 172.21.15.77:0/2402178889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc950003a30 msgr2=0x7fc950003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.044+0000 7fc966f23700 1 --2- 172.21.15.77:0/2402178889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc950003a30 0x7fc950003e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9540016f0 tx=0x7fc950005880 comp rx=0 tx=0).stop 2023-08-31T00:27:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.044+0000 7fc9654c0700 1 -- 172.21.15.77:0/2402178889 reap_dead start 2023-08-31T00:27:27.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.045+0000 7fc966f23700 1 -- 172.21.15.77:0/2402178889 shutdown_connections 2023-08-31T00:27:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.045+0000 7fc966f23700 1 -- 172.21.15.77:0/2402178889 >> 172.21.15.77:0/2402178889 conn(0x7fc96006cbf0 msgr2=0x7fc96006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.045+0000 7fc966f23700 1 -- 172.21.15.77:0/2402178889 shutdown_connections 2023-08-31T00:27:27.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.045+0000 7fc966f23700 1 -- 172.21.15.77:0/2402178889 wait complete. 2023-08-31T00:27:27.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.046+0000 7fc966f23700 1 Processor -- start 2023-08-31T00:27:27.050 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.046+0000 7fc966f23700 1 -- start start 2023-08-31T00:27:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc950003a30 0x7fc9601f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 0x7fc9601603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9600c3c20 0x7fc9600c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c45e0 con 0x7fc9600c6630 2023-08-31T00:27:27.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c6ab0 con 0x7fc950003a30 2023-08-31T00:27:27.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600ae2c0 con 0x7fc9600c3c20 2023-08-31T00:27:27.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 0x7fc9601603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 0x7fc9601603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39372/0 (socket says 172.21.15.77:39372) 2023-08-31T00:27:27.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 -- 172.21.15.77:0/270874991 learned_addr learned my addr 172.21.15.77:0/270874991 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:27.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc964cbf700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc950003a30 0x7fc9601f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc9654c0700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9600c3c20 0x7fc9600c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 -- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9600c3c20 msgr2=0x7fc9600c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9600c3c20 0x7fc9600c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 -- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc950003a30 msgr2=0x7fc9601f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc950003a30 0x7fc9601f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 -- 172.21.15.77:0/270874991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96015bab0 con 0x7fc9600c6630 2023-08-31T00:27:27.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc9654c0700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9600c3c20 0x7fc9600c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:27.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc964cbf700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc950003a30 0x7fc9601f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:27.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95ffff700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 0x7fc9601603b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc94c006660 tx=0x7fc94c006740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:27.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c011430 con 0x7fc9600c6630 2023-08-31T00:27:27.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc94c011590 con 0x7fc9600c6630 2023-08-31T00:27:27.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9601f2f80 con 0x7fc9600c6630 2023-08-31T00:27:27.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0119a0 con 0x7fc9600c6630 2023-08-31T00:27:27.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.047+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9601f3540 con 0x7fc9600c6630 2023-08-31T00:27:27.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.048+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc960073c30 con 0x7fc9600c6630 2023-08-31T00:27:27.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.049+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc94c011b00 con 0x7fc9600c6630 2023-08-31T00:27:27.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.049+0000 7fc95d7fa700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a110 0x7fc94406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.049+0000 7fc964cbf700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a110 0x7fc94406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.049+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc94c0892c0 con 0x7fc9600c6630 2023-08-31T00:27:27.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.050+0000 7fc964cbf700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a110 0x7fc94406c5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9540016f0 tx=0x7fc954001190 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:27.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.054+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc94c054b50 con 0x7fc9600c6630 2023-08-31T00:27:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.245+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9600ae400 con 0x7fc9600c6630 2023-08-31T00:27:27.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.246+0000 7fc95d7fa700 1 -- 172.21.15.77:0/270874991 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fc94c011db0 con 0x7fc9600c6630 2023-08-31T00:27:27.248 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:27.249 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:27.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a110 msgr2=0x7fc94406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a110 0x7fc94406c5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9540016f0 tx=0x7fc954001190 comp rx=0 tx=0).stop 2023-08-31T00:27:27.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 msgr2=0x7fc9601603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 0x7fc9601603b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc94c006660 tx=0x7fc94c006740 comp rx=0 tx=0).stop 2023-08-31T00:27:27.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 shutdown_connections 2023-08-31T00:27:27.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a110 0x7fc94406c5d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9600c3c20 0x7fc9600c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc950003a30 0x7fc9601f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 --2- 172.21.15.77:0/270874991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9600c6630 0x7fc9601603b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 >> 172.21.15.77:0/270874991 conn(0x7fc96006cbf0 msgr2=0x7fc960152640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:27.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 shutdown_connections 2023-08-31T00:27:27.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.248+0000 7fc966f23700 1 -- 172.21.15.77:0/270874991 wait complete. 2023-08-31T00:27:27.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:27.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:27.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 -- 172.21.15.77:0/1974948275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 msgr2=0x7f39d40c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 --2- 172.21.15.77:0/1974948275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 0x7f39d40c96b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009f60 tx=0x7f39cc009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:27.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 -- 172.21.15.77:0/1974948275 shutdown_connections 2023-08-31T00:27:27.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 --2- 172.21.15.77:0/1974948275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 0x7f39d40c96b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 --2- 172.21.15.77:0/1974948275 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f39d406f130 0x7f39d4070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 -- 172.21.15.77:0/1974948275 >> 172.21.15.77:0/1974948275 conn(0x7f39d406cbf0 msgr2=0x7f39d406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:27.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 -- 172.21.15.77:0/1974948275 shutdown_connections 2023-08-31T00:27:27.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.391+0000 7f39dbac3700 1 -- 172.21.15.77:0/1974948275 wait complete. 2023-08-31T00:27:27.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.392+0000 7f39dbac3700 1 Processor -- start 2023-08-31T00:27:27.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.392+0000 7f39dbac3700 1 -- start start 2023-08-31T00:27:27.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39dbac3700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f39d406f130 0x7f39d40af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39dbac3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 0x7f39d40c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39dbac3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 0x7f39d41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39dbac3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40c2c40 con 0x7f39d41580f0 2023-08-31T00:27:27.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39dbac3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40c4950 con 0x7f39d4071000 2023-08-31T00:27:27.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39dbac3700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40c2eb0 con 0x7f39d406f130 2023-08-31T00:27:27.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39da060700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 0x7f39d41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39da060700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 0x7f39d41534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39388/0 (socket says 172.21.15.77:39388) 2023-08-31T00:27:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.393+0000 7f39da060700 1 -- 172.21.15.77:0/2397167605 learned_addr learned my addr 172.21.15.77:0/2397167605 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39d985f700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f39d406f130 0x7f39d40af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39d905e700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 0x7f39d40c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39da060700 1 -- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f39d406f130 msgr2=0x7f39d40af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39da060700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f39d406f130 0x7f39d40af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39da060700 1 -- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 msgr2=0x7f39d40c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39da060700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 0x7f39d40c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39da060700 1 -- 172.21.15.77:0/2397167605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc009c40 con 0x7f39d41580f0 2023-08-31T00:27:27.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39da060700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 0x7f39d41534a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00b610 tx=0x7f39cc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:27.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00e040 con 0x7f39d41580f0 2023-08-31T00:27:27.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f39cc01d8b0 con 0x7f39d41580f0 2023-08-31T00:27:27.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d40c3190 con 0x7f39d41580f0 2023-08-31T00:27:27.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc006000 con 0x7f39d41580f0 2023-08-31T00:27:27.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.394+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d40c3750 con 0x7f39d41580f0 2023-08-31T00:27:27.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.395+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d4073c30 con 0x7f39d41580f0 2023-08-31T00:27:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.395+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39cc01dcc0 con 0x7f39d41580f0 2023-08-31T00:27:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.396+0000 7f39ca7fc700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f39b806a110 0x7f39b806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.396+0000 7f39d985f700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f39b806a110 0x7f39b806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.396+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39cc08a5b0 con 0x7f39d41580f0 2023-08-31T00:27:27.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.396+0000 7f39d985f700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f39b806a110 0x7f39b806c5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d0007fd0 tx=0x7f39d0009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:27.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.400+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f39cc055e20 con 0x7f39d41580f0 2023-08-31T00:27:27.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.592+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39d40c3910 con 0x7f39d41580f0 2023-08-31T00:27:27.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.592+0000 7f39ca7fc700 1 -- 172.21.15.77:0/2397167605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39cc059440 con 0x7f39d41580f0 2023-08-31T00:27:27.594 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:27.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.594+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f39b806a110 msgr2=0x7f39b806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.594+0000 7f39dbac3700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f39b806a110 0x7f39b806c5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d0007fd0 tx=0x7f39d0009040 comp rx=0 tx=0).stop 2023-08-31T00:27:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.594+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 msgr2=0x7f39d41534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.594+0000 7f39dbac3700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 0x7f39d41534a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00b610 tx=0x7f39cc007bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.594+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 shutdown_connections 2023-08-31T00:27:27.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.594+0000 7f39dbac3700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f39b806a110 0x7f39b806c5d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.595+0000 7f39dbac3700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f39d406f130 0x7f39d40af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.595+0000 7f39dbac3700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f39d41580f0 0x7f39d41534a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.595+0000 7f39dbac3700 1 --2- 172.21.15.77:0/2397167605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d4071000 0x7f39d40c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.595+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 >> 172.21.15.77:0/2397167605 conn(0x7f39d406cbf0 msgr2=0x7f39d4159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:27.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.595+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 shutdown_connections 2023-08-31T00:27:27.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.595+0000 7f39dbac3700 1 -- 172.21.15.77:0/2397167605 wait complete. 2023-08-31T00:27:27.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:27.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 -- 172.21.15.77:0/450840917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155bc0 msgr2=0x7f7854159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 --2- 172.21.15.77:0/450840917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155bc0 0x7f7854159300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f785406dd00 tx=0x7f7844009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 -- 172.21.15.77:0/450840917 shutdown_connections 2023-08-31T00:27:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 --2- 172.21.15.77:0/450840917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155bc0 0x7f7854159300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 --2- 172.21.15.77:0/450840917 >> v2:172.21.15.139:3300/0 conn(0x7f7854155fa0 0x7f78540702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 -- 172.21.15.77:0/450840917 >> 172.21.15.77:0/450840917 conn(0x7f7854069d50 msgr2=0x7f785406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 -- 172.21.15.77:0/450840917 shutdown_connections 2023-08-31T00:27:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.733+0000 7f785b825700 1 -- 172.21.15.77:0/450840917 wait complete. 2023-08-31T00:27:27.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.734+0000 7f785b825700 1 Processor -- start 2023-08-31T00:27:27.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.734+0000 7f785b825700 1 -- start start 2023-08-31T00:27:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78540cd1f0 0x7f78541f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7854155bc0 0x7f78541573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 0x7f7854157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854138a50 con 0x7f7854155fa0 2023-08-31T00:27:27.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785415a530 con 0x7f7854155bc0 2023-08-31T00:27:27.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854138400 con 0x7f78540cd1f0 2023-08-31T00:27:27.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 0x7f7854157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 0x7f7854157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39402/0 (socket says 172.21.15.77:39402) 2023-08-31T00:27:27.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 -- 172.21.15.77:0/2322875666 learned_addr learned my addr 172.21.15.77:0/2322875666 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:27.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f78595c1700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78540cd1f0 0x7f78541f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7858dc0700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7854155bc0 0x7f78541573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 -- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78540cd1f0 msgr2=0x7f78541f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78540cd1f0 0x7f78541f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 -- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7854155bc0 msgr2=0x7f78541573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7854155bc0 0x7f78541573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 -- 172.21.15.77:0/2322875666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78440095f0 con 0x7f7854155fa0 2023-08-31T00:27:27.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7858dc0700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7854155bc0 0x7f78541573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:27.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f78595c1700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78540cd1f0 0x7f78541f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:27.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7859dc2700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 0x7f7854157930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c7a0 tx=0x7f784c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:27.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c003e10 con 0x7f7854155fa0 2023-08-31T00:27:27.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f784c005180 con 0x7f7854155fa0 2023-08-31T00:27:27.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78541386e0 con 0x7f7854155fa0 2023-08-31T00:27:27.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.735+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c005590 con 0x7f7854155fa0 2023-08-31T00:27:27.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.736+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78541598e0 con 0x7f7854155fa0 2023-08-31T00:27:27.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.736+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7854138870 con 0x7f7854155fa0 2023-08-31T00:27:27.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.737+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f784c0056f0 con 0x7f7854155fa0 2023-08-31T00:27:27.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.737+0000 7f7849ffb700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f783806a0e0 0x7f783806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:27.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.737+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f784c087d10 con 0x7f7854155fa0 2023-08-31T00:27:27.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.737+0000 7f78595c1700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f783806a0e0 0x7f783806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:27.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.738+0000 7f78595c1700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f783806a0e0 0x7f783806c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f785415aba0 tx=0x7f78440047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:27.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.742+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f784c053580 con 0x7f7854155fa0 2023-08-31T00:27:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.932+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7854073c30 con 0x7f7854155fa0 2023-08-31T00:27:27.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.933+0000 7f7849ffb700 1 -- 172.21.15.77:0/2322875666 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f784c056ba0 con 0x7f7854155fa0 2023-08-31T00:27:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f783806a0e0 msgr2=0x7f783806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f783806a0e0 0x7f783806c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f785415aba0 tx=0x7f78440047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 msgr2=0x7f7854157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 0x7f7854157930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c7a0 tx=0x7f784c00cb60 comp rx=0 tx=0).stop 2023-08-31T00:27:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 shutdown_connections 2023-08-31T00:27:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f783806a0e0 0x7f783806c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78540cd1f0 0x7f78541f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7854155fa0 0x7f7854157930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 --2- 172.21.15.77:0/2322875666 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7854155bc0 0x7f78541573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 >> 172.21.15.77:0/2322875666 conn(0x7f7854069d50 msgr2=0x7f785414df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 shutdown_connections 2023-08-31T00:27:27.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:27.935+0000 7f785b825700 1 -- 172.21.15.77:0/2322875666 wait complete. 2023-08-31T00:27:27.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:28.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 -- 172.21.15.77:0/1011807526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06e6e0 msgr2=0x7f1aac06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 --2- 172.21.15.77:0/1011807526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06e6e0 0x7f1aac06ab20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0098f0 tx=0x7f1a9c009c00 comp rx=0 tx=0).stop 2023-08-31T00:27:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 -- 172.21.15.77:0/1011807526 shutdown_connections 2023-08-31T00:27:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 --2- 172.21.15.77:0/1011807526 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06b060 0x7f1aac0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 --2- 172.21.15.77:0/1011807526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06e6e0 0x7f1aac06ab20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 -- 172.21.15.77:0/1011807526 >> 172.21.15.77:0/1011807526 conn(0x7f1aac070270 msgr2=0x7f1aac070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 -- 172.21.15.77:0/1011807526 shutdown_connections 2023-08-31T00:27:28.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.071+0000 7f1ab4472700 1 -- 172.21.15.77:0/1011807526 wait complete. 2023-08-31T00:27:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 Processor -- start 2023-08-31T00:27:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 -- start start 2023-08-31T00:27:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06b060 0x7f1aac0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06e6e0 0x7f1aac148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 0x7f1aac0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0c0e40 con 0x7f1aac0ace10 2023-08-31T00:27:28.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0c1120 con 0x7f1aac06b060 2023-08-31T00:27:28.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab4472700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0c1400 con 0x7f1aac06e6e0 2023-08-31T00:27:28.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab2a0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 0x7f1aac0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab2a0f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 0x7f1aac0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39416/0 (socket says 172.21.15.77:39416) 2023-08-31T00:27:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.073+0000 7f1ab2a0f700 1 -- 172.21.15.77:0/2467367508 learned_addr learned my addr 172.21.15.77:0/2467367508 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab1a0d700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06e6e0 0x7f1aac148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab220e700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06b060 0x7f1aac0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab2a0f700 1 -- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06e6e0 msgr2=0x7f1aac148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab2a0f700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06e6e0 0x7f1aac148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab2a0f700 1 -- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06b060 msgr2=0x7f1aac0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab2a0f700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06b060 0x7f1aac0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab2a0f700 1 -- 172.21.15.77:0/2467367508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4009c40 con 0x7f1aac0ace10 2023-08-31T00:27:28.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab1a0d700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06e6e0 0x7f1aac148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab2a0f700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 0x7f1aac0b2480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c0f0 tx=0x7f1aa400c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400cb60 con 0x7f1aac0ace10 2023-08-31T00:27:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1aa400e030 con 0x7f1aac0ace10 2023-08-31T00:27:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4003a00 con 0x7f1aac0ace10 2023-08-31T00:27:28.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c009520 con 0x7f1aac0ace10 2023-08-31T00:27:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.074+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac14a500 con 0x7f1aac0ace10 2023-08-31T00:27:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.075+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac073c30 con 0x7f1aac0ace10 2023-08-31T00:27:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.076+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1aa4007500 con 0x7f1aac0ace10 2023-08-31T00:27:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.076+0000 7f1aa2ffd700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a9006a0e0 0x7f1a9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.076+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aa4088b00 con 0x7f1aac0ace10 2023-08-31T00:27:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.076+0000 7f1ab220e700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a9006a0e0 0x7f1a9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.076+0000 7f1ab220e700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a9006a0e0 0x7f1a9006c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8001620 tx=0x7f1aa8009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.080+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1aa4054370 con 0x7f1aac0ace10 2023-08-31T00:27:28.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.270+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1aac065ec0 con 0x7f1aac0ace10 2023-08-31T00:27:28.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.270+0000 7f1aa2ffd700 1 -- 172.21.15.77:0/2467367508 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1aa4057990 con 0x7f1aac0ace10 2023-08-31T00:27:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:28.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a9006a0e0 msgr2=0x7f1a9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a9006a0e0 0x7f1a9006c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8001620 tx=0x7f1aa8009040 comp rx=0 tx=0).stop 2023-08-31T00:27:28.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 msgr2=0x7f1aac0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 0x7f1aac0b2480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c0f0 tx=0x7f1aa400c4b0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 shutdown_connections 2023-08-31T00:27:28.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1a9006a0e0 0x7f1a9006c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac0ace10 0x7f1aac0b2480 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1aac06b060 0x7f1aac0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 --2- 172.21.15.77:0/2467367508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1aac06e6e0 0x7f1aac148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.272+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 >> 172.21.15.77:0/2467367508 conn(0x7f1aac070270 msgr2=0x7f1aac158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:28.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.273+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 shutdown_connections 2023-08-31T00:27:28.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.273+0000 7f1ab4472700 1 -- 172.21.15.77:0/2467367508 wait complete. 2023-08-31T00:27:28.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 -- 172.21.15.77:0/1972619994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 msgr2=0x7fd6840cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 --2- 172.21.15.77:0/1972619994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd6840cc250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd6840c1750 tx=0x7fd674009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 -- 172.21.15.77:0/1972619994 shutdown_connections 2023-08-31T00:27:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 --2- 172.21.15.77:0/1972619994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd6840cc250 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 --2- 172.21.15.77:0/1972619994 >> v2:172.21.15.139:3300/0 conn(0x7fd68406f130 0x7fd684070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 -- 172.21.15.77:0/1972619994 >> 172.21.15.77:0/1972619994 conn(0x7fd68406cbf0 msgr2=0x7fd68406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 -- 172.21.15.77:0/1972619994 shutdown_connections 2023-08-31T00:27:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.408+0000 7fd68a490700 1 -- 172.21.15.77:0/1972619994 wait complete. 2023-08-31T00:27:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.409+0000 7fd68a490700 1 Processor -- start 2023-08-31T00:27:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.409+0000 7fd68a490700 1 -- start start 2023-08-31T00:27:28.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd68406f130 0x7fd6841f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd684071000 0x7fd6840ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd684153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841f5630 con 0x7fd6841580f0 2023-08-31T00:27:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841f5020 con 0x7fd68406f130 2023-08-31T00:27:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840abc50 con 0x7fd684071000 2023-08-31T00:27:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd684153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd684153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39430/0 (socket says 172.21.15.77:39430) 2023-08-31T00:27:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 -- 172.21.15.77:0/3866876488 learned_addr learned my addr 172.21.15.77:0/3866876488 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:28.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 -- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd684071000 msgr2=0x7fd6840ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd6837fe700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd684071000 0x7fd6840ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd683fff700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd68406f130 0x7fd6841f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd684071000 0x7fd6840ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 -- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd68406f130 msgr2=0x7fd6841f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd68406f130 0x7fd6841f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 -- 172.21.15.77:0/3866876488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740095f0 con 0x7fd6841580f0 2023-08-31T00:27:28.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd6837fe700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd684071000 0x7fd6840ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:28.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd683fff700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd68406f130 0x7fd6841f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:28.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd688a2d700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd684153020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c7a0 tx=0x7fd67c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:28.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c003e10 con 0x7fd6841580f0 2023-08-31T00:27:28.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd67c005180 con 0x7fd6841580f0 2023-08-31T00:27:28.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6841f52c0 con 0x7fd6841580f0 2023-08-31T00:27:28.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c005590 con 0x7fd6841580f0 2023-08-31T00:27:28.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.410+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6840abf30 con 0x7fd6841580f0 2023-08-31T00:27:28.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.411+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6841f57e0 con 0x7fd6841580f0 2023-08-31T00:27:28.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.412+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd67c0056f0 con 0x7fd6841580f0 2023-08-31T00:27:28.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.412+0000 7fd680ff9700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd67006a0e0 0x7fd67006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.412+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd67c087a30 con 0x7fd6841580f0 2023-08-31T00:27:28.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.412+0000 7fd683fff700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd67006a0e0 0x7fd67006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.413+0000 7fd683fff700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd67006a0e0 0x7fd67006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6740098e0 tx=0x7fd674011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:28.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.416+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd6841f57e0 con 0x7fd6841580f0 2023-08-31T00:27:28.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.608+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd684158550 con 0x7fd6841580f0 2023-08-31T00:27:28.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.609+0000 7fd680ff9700 1 -- 172.21.15.77:0/3866876488 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7fd67c053220 con 0x7fd6841580f0 2023-08-31T00:27:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:28.611 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:28.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.611+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd67006a0e0 msgr2=0x7fd67006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd67006a0e0 0x7fd67006c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6740098e0 tx=0x7fd674011040 comp rx=0 tx=0).stop 2023-08-31T00:27:28.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 msgr2=0x7fd684153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd684153020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c7a0 tx=0x7fd67c00cb60 comp rx=0 tx=0).stop 2023-08-31T00:27:28.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 shutdown_connections 2023-08-31T00:27:28.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd67006a0e0 0x7fd67006c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6841580f0 0x7fd684153020 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd68406f130 0x7fd6841f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 --2- 172.21.15.77:0/3866876488 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd684071000 0x7fd6840ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 >> 172.21.15.77:0/3866876488 conn(0x7fd68406cbf0 msgr2=0x7fd684156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:28.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 shutdown_connections 2023-08-31T00:27:28.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.612+0000 7fd68a490700 1 -- 172.21.15.77:0/3866876488 wait complete. 2023-08-31T00:27:28.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:28.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:28.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 -- 172.21.15.77:0/1490638109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b06a0 msgr2=0x7f36ec06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 --2- 172.21.15.77:0/1490638109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b06a0 0x7f36ec06ab20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f36ec06b700 tx=0x7f36e8009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 -- 172.21.15.77:0/1490638109 shutdown_connections 2023-08-31T00:27:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 --2- 172.21.15.77:0/1490638109 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36ec0b0b00 0x7f36ec06b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 --2- 172.21.15.77:0/1490638109 >> v2:172.21.15.139:3300/0 conn(0x7f36ec0ace10 0x7f36ec06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 --2- 172.21.15.77:0/1490638109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b06a0 0x7f36ec06ab20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 -- 172.21.15.77:0/1490638109 >> 172.21.15.77:0/1490638109 conn(0x7f36ec070270 msgr2=0x7f36ec070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:28.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 -- 172.21.15.77:0/1490638109 shutdown_connections 2023-08-31T00:27:28.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.750+0000 7f36f414b700 1 -- 172.21.15.77:0/1490638109 wait complete. 2023-08-31T00:27:28.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 Processor -- start 2023-08-31T00:27:28.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 -- start start 2023-08-31T00:27:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36ec0ace10 0x7f36ec0c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36ec0b06a0 0x7f36ec148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 0x7f36ec148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec15c830 con 0x7f36ec0b0b00 2023-08-31T00:27:28.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0c4ac0 con 0x7f36ec0ace10 2023-08-31T00:27:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f414b700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0c4da0 con 0x7f36ec0b06a0 2023-08-31T00:27:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f26e8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 0x7f36ec148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f26e8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 0x7f36ec148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39444/0 (socket says 172.21.15.77:39444) 2023-08-31T00:27:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.752+0000 7f36f26e8700 1 -- 172.21.15.77:0/629342056 learned_addr learned my addr 172.21.15.77:0/629342056 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f16e6700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36ec0b06a0 0x7f36ec148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f1ee7700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36ec0ace10 0x7f36ec0c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f26e8700 1 -- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36ec0b06a0 msgr2=0x7f36ec148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f26e8700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36ec0b06a0 0x7f36ec148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f26e8700 1 -- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36ec0ace10 msgr2=0x7f36ec0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f26e8700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36ec0ace10 0x7f36ec0c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f26e8700 1 -- 172.21.15.77:0/629342056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80095f0 con 0x7f36ec0b0b00 2023-08-31T00:27:28.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f26e8700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 0x7f36ec148dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009690 tx=0x7f36e4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:28.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4004db0 con 0x7f36ec0b0b00 2023-08-31T00:27:28.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f36e400f040 con 0x7f36ec0b0b00 2023-08-31T00:27:28.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec0c5080 con 0x7f36ec0b0b00 2023-08-31T00:27:28.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400dc00 con 0x7f36ec0b0b00 2023-08-31T00:27:28.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.753+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec0c1560 con 0x7f36ec0b0b00 2023-08-31T00:27:28.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.754+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec0c4c00 con 0x7f36ec0b0b00 2023-08-31T00:27:28.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.755+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36e4005000 con 0x7f36ec0b0b00 2023-08-31T00:27:28.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.755+0000 7f36e27fc700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f36d006a0e0 0x7f36d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:28.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.755+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36e40882f0 con 0x7f36ec0b0b00 2023-08-31T00:27:28.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.755+0000 7f36f1ee7700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f36d006a0e0 0x7f36d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:28.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.755+0000 7f36f1ee7700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f36d006a0e0 0x7f36d006c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f36dc005e10 tx=0x7f36dc005d20 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:28.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.759+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f36ec0c4c00 con 0x7f36ec0b0b00 2023-08-31T00:27:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.949+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36ec155430 con 0x7f36ec0b0b00 2023-08-31T00:27:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.950+0000 7f36e27fc700 1 -- 172.21.15.77:0/629342056 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36ec155430 con 0x7f36ec0b0b00 2023-08-31T00:27:28.951 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f36d006a0e0 msgr2=0x7f36d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f36d006a0e0 0x7f36d006c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f36dc005e10 tx=0x7f36dc005d20 comp rx=0 tx=0).stop 2023-08-31T00:27:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 msgr2=0x7f36ec148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 0x7f36ec148dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009690 tx=0x7f36e4007f40 comp rx=0 tx=0).stop 2023-08-31T00:27:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 shutdown_connections 2023-08-31T00:27:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f36d006a0e0 0x7f36d006c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36ec0b0b00 0x7f36ec148dd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36ec0ace10 0x7f36ec0c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 --2- 172.21.15.77:0/629342056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f36ec0b06a0 0x7f36ec148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 >> 172.21.15.77:0/629342056 conn(0x7f36ec070270 msgr2=0x7f36ec0aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 shutdown_connections 2023-08-31T00:27:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:28.952+0000 7f36f414b700 1 -- 172.21.15.77:0/629342056 wait complete. 2023-08-31T00:27:28.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 -- 172.21.15.77:0/3414579669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a406f130 msgr2=0x7f78a4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 --2- 172.21.15.77:0/3414579669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a406f130 0x7f78a4070ac0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f78a4071d50 tx=0x7f7890009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:29.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 -- 172.21.15.77:0/3414579669 shutdown_connections 2023-08-31T00:27:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 --2- 172.21.15.77:0/3414579669 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78a4071000 0x7f78a415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 --2- 172.21.15.77:0/3414579669 >> v2:172.21.15.139:3300/0 conn(0x7f78a41580f0 0x7f78a40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 --2- 172.21.15.77:0/3414579669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a406f130 0x7f78a4070ac0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 -- 172.21.15.77:0/3414579669 >> 172.21.15.77:0/3414579669 conn(0x7f78a406cbf0 msgr2=0x7f78a406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:29.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 -- 172.21.15.77:0/3414579669 shutdown_connections 2023-08-31T00:27:29.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.091+0000 7f78aabe9700 1 -- 172.21.15.77:0/3414579669 wait complete. 2023-08-31T00:27:29.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.092+0000 7f78aabe9700 1 Processor -- start 2023-08-31T00:27:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.092+0000 7f78aabe9700 1 -- start start 2023-08-31T00:27:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78aabe9700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78a406f130 0x7f78a414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78aabe9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 0x7f78a40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78aabe9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a41580f0 0x7f78a40c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78aabe9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414de60 con 0x7f78a4071000 2023-08-31T00:27:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78aabe9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4150cc0 con 0x7f78a41580f0 2023-08-31T00:27:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78aabe9700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414e0b0 con 0x7f78a406f130 2023-08-31T00:27:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78a3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 0x7f78a40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78a3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 0x7f78a40c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39456/0 (socket says 172.21.15.77:39456) 2023-08-31T00:27:29.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78a3fff700 1 -- 172.21.15.77:0/1674230603 learned_addr learned my addr 172.21.15.77:0/1674230603 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78a8985700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78a406f130 0x7f78a414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.093+0000 7f78a9186700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a41580f0 0x7f78a40c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a3fff700 1 -- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78a406f130 msgr2=0x7f78a414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a3fff700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78a406f130 0x7f78a414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a3fff700 1 -- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a41580f0 msgr2=0x7f78a40c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a3fff700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a41580f0 0x7f78a40c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a3fff700 1 -- 172.21.15.77:0/1674230603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900095f0 con 0x7f78a4071000 2023-08-31T00:27:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a9186700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a41580f0 0x7f78a40c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a3fff700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 0x7f78a40c50f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7890005fd0 tx=0x7f7890004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789001d070 con 0x7f78a4071000 2023-08-31T00:27:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7890003910 con 0x7f78a4071000 2023-08-31T00:27:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a414e390 con 0x7f78a4071000 2023-08-31T00:27:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890003d00 con 0x7f78a4071000 2023-08-31T00:27:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.094+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a414e950 con 0x7f78a4071000 2023-08-31T00:27:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.095+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a414eb70 con 0x7f78a4071000 2023-08-31T00:27:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.095+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f789000f460 con 0x7f78a4071000 2023-08-31T00:27:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.096+0000 7f78a17fa700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f788806a0e0 0x7f788806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.096+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7890089de0 con 0x7f78a4071000 2023-08-31T00:27:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.096+0000 7f78a8985700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f788806a0e0 0x7f788806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.096+0000 7f78a8985700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f788806a0e0 0x7f788806c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7898006fd0 tx=0x7f7898008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.100+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f78900555d0 con 0x7f78a4071000 2023-08-31T00:27:29.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.289+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78a41585b0 con 0x7f78a4071000 2023-08-31T00:27:29.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.290+0000 7f78a17fa700 1 -- 172.21.15.77:0/1674230603 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7890003e60 con 0x7f78a4071000 2023-08-31T00:27:29.290 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f788806a0e0 msgr2=0x7f788806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f788806a0e0 0x7f788806c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7898006fd0 tx=0x7f7898008040 comp rx=0 tx=0).stop 2023-08-31T00:27:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 msgr2=0x7f78a40c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 0x7f78a40c50f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7890005fd0 tx=0x7f7890004310 comp rx=0 tx=0).stop 2023-08-31T00:27:29.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 shutdown_connections 2023-08-31T00:27:29.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f788806a0e0 0x7f788806c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f78a406f130 0x7f78a414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a41580f0 0x7f78a40c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 --2- 172.21.15.77:0/1674230603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a4071000 0x7f78a40c50f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 >> 172.21.15.77:0/1674230603 conn(0x7f78a406cbf0 msgr2=0x7f78a4158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:29.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 shutdown_connections 2023-08-31T00:27:29.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.292+0000 7f78aabe9700 1 -- 172.21.15.77:0/1674230603 wait complete. 2023-08-31T00:27:29.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:29.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 -- 172.21.15.77:0/2829754382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000ce7f0 msgr2=0x7f6c0015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 --2- 172.21.15.77:0/2829754382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015ef30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c000b3ed0 tx=0x7f6bf800b380 comp rx=0 tx=0).stop 2023-08-31T00:27:29.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 -- 172.21.15.77:0/2829754382 shutdown_connections 2023-08-31T00:27:29.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 --2- 172.21.15.77:0/2829754382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015ef30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 --2- 172.21.15.77:0/2829754382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6c0015b3d0 0x7f6c000cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 --2- 172.21.15.77:0/2829754382 >> v2:172.21.15.139:3300/0 conn(0x7f6c000b04a0 0x7f6c000ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.430 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 -- 172.21.15.77:0/2829754382 >> 172.21.15.77:0/2829754382 conn(0x7f6c00071630 msgr2=0x7f6c00071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:29.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 -- 172.21.15.77:0/2829754382 shutdown_connections 2023-08-31T00:27:29.431 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.429+0000 7f6c0528d700 1 -- 172.21.15.77:0/2829754382 wait complete. 2023-08-31T00:27:29.433 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.430+0000 7f6c0528d700 1 Processor -- start 2023-08-31T00:27:29.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.430+0000 7f6c0528d700 1 -- start start 2023-08-31T00:27:29.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6c0528d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 0x7f6c000c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6c0528d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6c0528d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6c0015b3d0 0x7f6c0014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6c0528d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000c6e90 con 0x7f6c000b04a0 2023-08-31T00:27:29.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6c0528d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000c6280 con 0x7f6c000ce7f0 2023-08-31T00:27:29.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6c0528d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000c6560 con 0x7f6c0015b3d0 2023-08-31T00:27:29.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 0x7f6c000c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 0x7f6c000c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39468/0 (socket says 172.21.15.77:39468) 2023-08-31T00:27:29.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 -- 172.21.15.77:0/4268905245 learned_addr learned my addr 172.21.15.77:0/4268905245 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:29.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfe7fc700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bff7fe700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6c0015b3d0 0x7f6c0014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 -- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6c0015b3d0 msgr2=0x7f6c0014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6c0015b3d0 0x7f6c0014f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 -- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c000ce7f0 msgr2=0x7f6c0015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 -- 172.21.15.77:0/4268905245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009d00 con 0x7f6c000b04a0 2023-08-31T00:27:29.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfe7fc700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.431+0000 7f6bfeffd700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 0x7f6c000c7320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000b4a0 tx=0x7f6bf000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.432+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0011830 con 0x7f6c000b04a0 2023-08-31T00:27:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.432+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6bf0011a80 con 0x7f6c000b04a0 2023-08-31T00:27:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.432+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c000c6840 con 0x7f6c000b04a0 2023-08-31T00:27:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.432+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0011e90 con 0x7f6c000b04a0 2023-08-31T00:27:29.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.432+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0015c8a0 con 0x7f6c000b04a0 2023-08-31T00:27:29.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.433+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c000c7170 con 0x7f6c000b04a0 2023-08-31T00:27:29.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.433+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6bf001a400 con 0x7f6c000b04a0 2023-08-31T00:27:29.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.433+0000 7f6be77fe700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6bec06a0e0 0x7f6bec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.434+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bf0088660 con 0x7f6c000b04a0 2023-08-31T00:27:29.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.434+0000 7f6bfe7fc700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6bec06a0e0 0x7f6bec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.434+0000 7f6bfe7fc700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6bec06a0e0 0x7f6bec06c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4005fd0 tx=0x7f6bf4005de0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:29.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.438+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6bf0053e50 con 0x7f6c000b04a0 2023-08-31T00:27:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.628+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c00073c30 con 0x7f6c000b04a0 2023-08-31T00:27:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.629+0000 7f6be77fe700 1 -- 172.21.15.77:0/4268905245 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6bf0057470 con 0x7f6c000b04a0 2023-08-31T00:27:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:29.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6bec06a0e0 msgr2=0x7f6bec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6bec06a0e0 0x7f6bec06c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4005fd0 tx=0x7f6bf4005de0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 msgr2=0x7f6c000c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 0x7f6c000c7320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000b4a0 tx=0x7f6bf000b860 comp rx=0 tx=0).stop 2023-08-31T00:27:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 shutdown_connections 2023-08-31T00:27:29.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6bec06a0e0 0x7f6bec06c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6c0015b3d0 0x7f6c0014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c000b04a0 0x7f6c000c7320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 --2- 172.21.15.77:0/4268905245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c000ce7f0 0x7f6c0015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 >> 172.21.15.77:0/4268905245 conn(0x7f6c00071630 msgr2=0x7f6c000b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:29.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 shutdown_connections 2023-08-31T00:27:29.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.631+0000 7f6c0528d700 1 -- 172.21.15.77:0/4268905245 wait complete. 2023-08-31T00:27:29.649 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-08-31T00:27:29.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-08-31T00:27:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/2190362855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 msgr2=0x7fbe3815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/2190362855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe3815c370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbe38073460 tx=0x7fbe3000b380 comp rx=0 tx=0).stop 2023-08-31T00:27:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/2190362855 shutdown_connections 2023-08-31T00:27:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/2190362855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe3815c370 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/2190362855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbe3815b860 0x7fbe3806df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/2190362855 >> v2:172.21.15.139:3300/0 conn(0x7fbe380cc8e0 0x7fbe380ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/2190362855 >> 172.21.15.77:0/2190362855 conn(0x7fbe380afbf0 msgr2=0x7fbe380affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/2190362855 shutdown_connections 2023-08-31T00:27:29.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.774+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/2190362855 wait complete. 2023-08-31T00:27:29.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.775+0000 7fbe3d6c0700 1 Processor -- start 2023-08-31T00:27:29.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.775+0000 7fbe3d6c0700 1 -- start start 2023-08-31T00:27:29.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe380cc8e0 0x7fbe381f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbe3815b860 0x7fbe381ee560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe380b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380c27f0 con 0x7fbe3815bf10 2023-08-31T00:27:29.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380c2a40 con 0x7fbe380cc8e0 2023-08-31T00:27:29.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380c2d20 con 0x7fbe3815b860 2023-08-31T00:27:29.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe380b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe380b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39486/0 (socket says 172.21.15.77:39486) 2023-08-31T00:27:29.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 -- 172.21.15.77:0/423211537 learned_addr learned my addr 172.21.15.77:0/423211537 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:29.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe36ffd700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe380cc8e0 0x7fbe381f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe367fc700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbe3815b860 0x7fbe381ee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 -- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbe3815b860 msgr2=0x7fbe381ee560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbe3815b860 0x7fbe381ee560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 -- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe380cc8e0 msgr2=0x7fbe381f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe380cc8e0 0x7fbe381f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 -- 172.21.15.77:0/423211537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009d00 con 0x7fbe3815bf10 2023-08-31T00:27:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe377fe700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe380b1770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe380706b0 tx=0x7fbe30009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000e040 con 0x7fbe3815bf10 2023-08-31T00:27:29.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbe3001d6a0 con 0x7fbe3815bf10 2023-08-31T00:27:29.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe380c3000 con 0x7fbe3815bf10 2023-08-31T00:27:29.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.776+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3001daf0 con 0x7fbe3815bf10 2023-08-31T00:27:29.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.777+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe38156710 con 0x7fbe3815bf10 2023-08-31T00:27:29.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.777+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe381568a0 con 0x7fbe3815bf10 2023-08-31T00:27:29.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.778+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe3001dc50 con 0x7fbe3815bf10 2023-08-31T00:27:29.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.778+0000 7fbe1f7fe700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbe2406c2f0 0x7fbe2406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:29.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.778+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe30089df0 con 0x7fbe3815bf10 2023-08-31T00:27:29.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.778+0000 7fbe36ffd700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbe2406c2f0 0x7fbe2406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:29.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.779+0000 7fbe36ffd700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbe2406c2f0 0x7fbe2406e7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c005950 tx=0x7fbe2c00b410 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:29.783+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbe30055660 con 0x7fbe3815bf10 2023-08-31T00:27:30.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.049+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fbe38073c30 con 0x7fbe3815bf10 2023-08-31T00:27:30.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.509+0000 7fbe1f7fe700 1 -- 172.21.15.77:0/423211537 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v53) v1 ==== 147+0+0 (secure 0 0 0) 0x7fbe30058c80 con 0x7fbe3815bf10 2023-08-31T00:27:30.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbe2406c2f0 msgr2=0x7fbe2406e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbe2406c2f0 0x7fbe2406e7b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c005950 tx=0x7fbe2c00b410 comp rx=0 tx=0).stop 2023-08-31T00:27:30.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 msgr2=0x7fbe380b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe380b1770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe380706b0 tx=0x7fbe30009800 comp rx=0 tx=0).stop 2023-08-31T00:27:30.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 shutdown_connections 2023-08-31T00:27:30.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbe2406c2f0 0x7fbe2406e7b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe3815bf10 0x7fbe380b1770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe380cc8e0 0x7fbe381f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 --2- 172.21.15.77:0/423211537 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbe3815b860 0x7fbe381ee560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 >> 172.21.15.77:0/423211537 conn(0x7fbe380afbf0 msgr2=0x7fbe3815c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:30.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 shutdown_connections 2023-08-31T00:27:30.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.511+0000 7fbe3d6c0700 1 -- 172.21.15.77:0/423211537 wait complete. 2023-08-31T00:27:30.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-08-31T00:27:30.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 -- 172.21.15.77:0/1141417448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 msgr2=0x7f38000cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 --2- 172.21.15.77:0/1141417448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f38000cc250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f38000cb890 tx=0x7f37f4009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:30.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 -- 172.21.15.77:0/1141417448 shutdown_connections 2023-08-31T00:27:30.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 --2- 172.21.15.77:0/1141417448 >> v2:172.21.15.139:3300/0 conn(0x7f3800071000 0x7f380015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 --2- 172.21.15.77:0/1141417448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f38000cc250 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 --2- 172.21.15.77:0/1141417448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f380006f130 0x7f3800070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 -- 172.21.15.77:0/1141417448 >> 172.21.15.77:0/1141417448 conn(0x7f380006cbf0 msgr2=0x7f380006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:30.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 -- 172.21.15.77:0/1141417448 shutdown_connections 2023-08-31T00:27:30.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.648+0000 7f3806fc7700 1 -- 172.21.15.77:0/1141417448 wait complete. 2023-08-31T00:27:30.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 Processor -- start 2023-08-31T00:27:30.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 -- start start 2023-08-31T00:27:30.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f380006f130 0x7f38000c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800071000 0x7f380014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f3800150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001f36b0 con 0x7f38001580f0 2023-08-31T00:27:30.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001f2aa0 con 0x7f3800071000 2023-08-31T00:27:30.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.650+0000 7f3806fc7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38001f2d80 con 0x7f380006f130 2023-08-31T00:27:30.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f3800150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f3800150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39500/0 (socket says 172.21.15.77:39500) 2023-08-31T00:27:30.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 -- 172.21.15.77:0/522727677 learned_addr learned my addr 172.21.15.77:0/522727677 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:30.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3804d63700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f380006f130 0x7f38000c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f37fffff700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800071000 0x7f380014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 -- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f380006f130 msgr2=0x7f38000c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f380006f130 0x7f38000c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 -- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800071000 msgr2=0x7f380014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800071000 0x7f380014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 -- 172.21.15.77:0/522727677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40095f0 con 0x7f38001580f0 2023-08-31T00:27:30.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f37fffff700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800071000 0x7f380014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:30.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3805564700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f3800150370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007ee0 tx=0x7f37f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:30.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8017070 con 0x7f38001580f0 2023-08-31T00:27:30.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f37f800f040 con 0x7f38001580f0 2023-08-31T00:27:30.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38001f3060 con 0x7f38001580f0 2023-08-31T00:27:30.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800de10 con 0x7f38001580f0 2023-08-31T00:27:30.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.651+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38000c5210 con 0x7f38001580f0 2023-08-31T00:27:30.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.652+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38001f3860 con 0x7f38001580f0 2023-08-31T00:27:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.653+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f37f8004bb0 con 0x7f38001580f0 2023-08-31T00:27:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.654+0000 7f37fd7fa700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f37e406a0e0 0x7f37e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.654+0000 7f3804d63700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f37e406a0e0 0x7f37e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.654+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f8088930 con 0x7f38001580f0 2023-08-31T00:27:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.654+0000 7f3804d63700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f37e406a0e0 0x7f37e406c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37f4000c00 tx=0x7f37f4011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:30.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.657+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f37f8057ce0 con 0x7f38001580f0 2023-08-31T00:27:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.847+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f38001585b0 con 0x7f38001580f0 2023-08-31T00:27:30.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.848+0000 7f37fd7fa700 1 -- 172.21.15.77:0/522727677 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2220 (secure 0 0 0) 0x7f37f8004e60 con 0x7f38001580f0 2023-08-31T00:27:30.848 INFO:teuthology.orchestra.run.smithi077.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-08-31T00:27:30.848 INFO:teuthology.orchestra.run.smithi077.stdout:mon advanced mon_op_complaint_time 120 2023-08-31T00:27:30.848 INFO:teuthology.orchestra.run.smithi077.stdout:osd advanced osd_op_complaint_time 180.000000 2023-08-31T00:27:30.848 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.932597 2023-08-31T00:27:30.849 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 6676.319482 2023-08-31T00:27:30.849 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6223.579079 2023-08-31T00:27:30.849 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 6552.748989 2023-08-31T00:27:30.849 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 6344.643912 2023-08-31T00:27:30.849 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6080.984582 2023-08-31T00:27:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6238.506254 2023-08-31T00:27:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5912.186518 2023-08-31T00:27:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced debug_mds 20/20 2023-08-31T00:27:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced debug_mds_balancer 20/20 2023-08-31T00:27:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced debug_ms 1/1 2023-08-31T00:27:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-08-31T00:27:30.851 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced mds_bal_merge_size 5 2023-08-31T00:27:30.851 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced mds_bal_split_bits 3 2023-08-31T00:27:30.851 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced mds_bal_split_size 100 2023-08-31T00:27:30.851 INFO:teuthology.orchestra.run.smithi077.stdout:mds dev mds_debug_frag true 2023-08-31T00:27:30.851 INFO:teuthology.orchestra.run.smithi077.stdout:mds dev mds_debug_scatterstat true 2023-08-31T00:27:30.852 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced mds_op_complaint_time 180.000000 2023-08-31T00:27:30.852 INFO:teuthology.orchestra.run.smithi077.stdout:mds dev mds_verify_scatter true 2023-08-31T00:27:30.852 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced osd_op_complaint_time 180.000000 2023-08-31T00:27:30.852 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced rados_mon_op_timeout 900 2023-08-31T00:27:30.852 INFO:teuthology.orchestra.run.smithi077.stdout:mds advanced rados_osd_op_timeout 900 2023-08-31T00:27:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:client advanced client_mount_timeout 600 2023-08-31T00:27:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:client advanced debug_client 20/20 2023-08-31T00:27:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:client advanced debug_ms 1/1 2023-08-31T00:27:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:client advanced rados_mon_op_timeout 900 2023-08-31T00:27:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:client advanced rados_osd_op_timeout 900 2023-08-31T00:27:30.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.849+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f37e406a0e0 msgr2=0x7f37e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.849+0000 7f3806fc7700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f37e406a0e0 0x7f37e406c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f37f4000c00 tx=0x7f37f4011040 comp rx=0 tx=0).stop 2023-08-31T00:27:30.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.849+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 msgr2=0x7f3800150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.849+0000 7f3806fc7700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f3800150370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007ee0 tx=0x7f37f800d3b0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 shutdown_connections 2023-08-31T00:27:30.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f37e406a0e0 0x7f37e406c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f380006f130 0x7f38000c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38001580f0 0x7f3800150370 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 --2- 172.21.15.77:0/522727677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3800071000 0x7f380014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 >> 172.21.15.77:0/522727677 conn(0x7f380006cbf0 msgr2=0x7f38000cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:30.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 shutdown_connections 2023-08-31T00:27:30.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.850+0000 7f3806fc7700 1 -- 172.21.15.77:0/522727677 wait complete. 2023-08-31T00:27:30.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:30.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 -- 172.21.15.77:0/17056340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 msgr2=0x7ff1780cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 --2- 172.21.15.77:0/17056340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1780cc250 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098c0 tx=0x7ff16c009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 -- 172.21.15.77:0/17056340 shutdown_connections 2023-08-31T00:27:30.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 --2- 172.21.15.77:0/17056340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1780cc250 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 --2- 172.21.15.77:0/17056340 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff1780711d0 0x7ff1780c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 -- 172.21.15.77:0/17056340 >> 172.21.15.77:0/17056340 conn(0x7ff17806cbf0 msgr2=0x7ff17806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:30.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 -- 172.21.15.77:0/17056340 shutdown_connections 2023-08-31T00:27:30.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.983+0000 7ff17d020700 1 -- 172.21.15.77:0/17056340 wait complete. 2023-08-31T00:27:30.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.985+0000 7ff17d020700 1 Processor -- start 2023-08-31T00:27:30.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.985+0000 7ff17d020700 1 -- start start 2023-08-31T00:27:30.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff17806f130 0x7ff17815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1780711d0 0x7ff17815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1781edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c6140 con 0x7ff1781580f0 2023-08-31T00:27:30.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781f2ac0 con 0x7ff1780711d0 2023-08-31T00:27:30.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c6390 con 0x7ff17806f130 2023-08-31T00:27:30.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1781edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1781edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39514/0 (socket says 172.21.15.77:39514) 2023-08-31T00:27:30.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 -- 172.21.15.77:0/667221382 learned_addr learned my addr 172.21.15.77:0/667221382 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:30.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff176d9d700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff17806f130 0x7ff17815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17659c700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1780711d0 0x7ff17815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 -- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff17806f130 msgr2=0x7ff17815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff17806f130 0x7ff17815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 -- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1780711d0 msgr2=0x7ff17815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:30.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1780711d0 0x7ff17815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:30.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 -- 172.21.15.77:0/667221382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009520 con 0x7ff1781580f0 2023-08-31T00:27:30.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff176d9d700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff17806f130 0x7ff17815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:30.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17759e700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1781edbc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff170007ce0 tx=0x7ff17000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:30.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000ddd0 con 0x7ff1781580f0 2023-08-31T00:27:30.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff17000f040 con 0x7ff1781580f0 2023-08-31T00:27:30.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1780c6670 con 0x7ff1781580f0 2023-08-31T00:27:30.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170004df0 con 0x7ff1781580f0 2023-08-31T00:27:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.986+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff178151100 con 0x7ff1781580f0 2023-08-31T00:27:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.987+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff178151320 con 0x7ff1781580f0 2023-08-31T00:27:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.988+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff170015400 con 0x7ff1781580f0 2023-08-31T00:27:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.988+0000 7ff15f7fe700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ff16406a0e0 0x7ff16406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.988+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff170088550 con 0x7ff1781580f0 2023-08-31T00:27:30.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.988+0000 7ff176d9d700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ff16406a0e0 0x7ff16406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:30.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.989+0000 7ff176d9d700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ff16406a0e0 0x7ff16406c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:30.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:30.993+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff170053d20 con 0x7ff1781580f0 2023-08-31T00:27:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.183+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1780731e0 con 0x7ff1781580f0 2023-08-31T00:27:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.184+0000 7ff15f7fe700 1 -- 172.21.15.77:0/667221382 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7ff17000e140 con 0x7ff1781580f0 2023-08-31T00:27:31.184 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:31.184 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:31.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ff16406a0e0 msgr2=0x7ff16406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ff16406a0e0 0x7ff16406c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff16c000c00 tx=0x7ff16c011040 comp rx=0 tx=0).stop 2023-08-31T00:27:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 msgr2=0x7ff1781edbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1781edbc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff170007ce0 tx=0x7ff17000d3b0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 shutdown_connections 2023-08-31T00:27:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7ff16406a0e0 0x7ff16406c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff17806f130 0x7ff17815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1781580f0 0x7ff1781edbc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 --2- 172.21.15.77:0/667221382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1780711d0 0x7ff17815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 >> 172.21.15.77:0/667221382 conn(0x7ff17806cbf0 msgr2=0x7ff1780cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 shutdown_connections 2023-08-31T00:27:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.186+0000 7ff17d020700 1 -- 172.21.15.77:0/667221382 wait complete. 2023-08-31T00:27:31.198 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:31.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 -- 172.21.15.77:0/3419006648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f406b230 msgr2=0x7f43f40acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 --2- 172.21.15.77:0/3419006648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f406b230 0x7f43f40acdc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009f60 tx=0x7f43ec009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 -- 172.21.15.77:0/3419006648 shutdown_connections 2023-08-31T00:27:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 --2- 172.21.15.77:0/3419006648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f406b230 0x7f43f40acdc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 --2- 172.21.15.77:0/3419006648 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43f415b730 0x7f43f415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 -- 172.21.15.77:0/3419006648 >> 172.21.15.77:0/3419006648 conn(0x7f43f4070270 msgr2=0x7f43f4070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 -- 172.21.15.77:0/3419006648 shutdown_connections 2023-08-31T00:27:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.326+0000 7f43fb3af700 1 -- 172.21.15.77:0/3419006648 wait complete. 2023-08-31T00:27:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.327+0000 7f43fb3af700 1 Processor -- start 2023-08-31T00:27:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.327+0000 7f43fb3af700 1 -- start start 2023-08-31T00:27:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43fb3af700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43f406b230 0x7f43f41ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43fb3af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 0x7f43f41f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43fb3af700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f415b730 0x7f43f40c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43fb3af700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41f18c0 con 0x7f43f4070d90 2023-08-31T00:27:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43fb3af700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c39f0 con 0x7f43f415b730 2023-08-31T00:27:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43fb3af700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40b0610 con 0x7f43f406b230 2023-08-31T00:27:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 0x7f43f41f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 0x7f43f41f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39526/0 (socket says 172.21.15.77:39526) 2023-08-31T00:27:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 -- 172.21.15.77:0/2489556797 learned_addr learned my addr 172.21.15.77:0/2489556797 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f914b700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43f406b230 0x7f43f41ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f994c700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f415b730 0x7f43f40c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 -- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43f406b230 msgr2=0x7f43f41ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43f406b230 0x7f43f41ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 -- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f415b730 msgr2=0x7f43f40c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f415b730 0x7f43f40c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.328+0000 7f43f894a700 1 -- 172.21.15.77:0/2489556797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0009520 con 0x7f43f4070d90 2023-08-31T00:27:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.329+0000 7f43f894a700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 0x7f43f41f1380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f43e400e710 tx=0x7f43e400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.329+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4004230 con 0x7f43f4070d90 2023-08-31T00:27:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.329+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec009c40 con 0x7f43f4070d90 2023-08-31T00:27:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.329+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f43e40044a0 con 0x7f43f4070d90 2023-08-31T00:27:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.329+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4010900 con 0x7f43f4070d90 2023-08-31T00:27:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.329+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f40b0bd0 con 0x7f43f4070d90 2023-08-31T00:27:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.330+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f40b0470 con 0x7f43f4070d90 2023-08-31T00:27:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.330+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43e4010a60 con 0x7f43f4070d90 2023-08-31T00:27:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.331+0000 7f43e9ffb700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43d806a0e0 0x7f43d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.331+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43e408a1b0 con 0x7f43f4070d90 2023-08-31T00:27:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.331+0000 7f43f914b700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43d806a0e0 0x7f43d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.331+0000 7f43f914b700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43d806a0e0 0x7f43d806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43f40b3560 tx=0x7f43f0009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.335+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43f40b0470 con 0x7f43f4070d90 2023-08-31T00:27:31.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.524+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43f40b0470 con 0x7f43f4070d90 2023-08-31T00:27:31.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.524+0000 7f43e9ffb700 1 -- 172.21.15.77:0/2489556797 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43f40b0470 con 0x7f43f4070d90 2023-08-31T00:27:31.524 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.526+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43d806a0e0 msgr2=0x7f43d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.526+0000 7f43fb3af700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43d806a0e0 0x7f43d806c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43f40b3560 tx=0x7f43f0009260 comp rx=0 tx=0).stop 2023-08-31T00:27:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.526+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 msgr2=0x7f43f41f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 0x7f43f41f1380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f43e400e710 tx=0x7f43e400ea20 comp rx=0 tx=0).stop 2023-08-31T00:27:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 shutdown_connections 2023-08-31T00:27:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f43d806a0e0 0x7f43d806c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43f406b230 0x7f43f41ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43f415b730 0x7f43f40c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 --2- 172.21.15.77:0/2489556797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43f4070d90 0x7f43f41f1380 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 >> 172.21.15.77:0/2489556797 conn(0x7f43f4070270 msgr2=0x7f43f40ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:31.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 shutdown_connections 2023-08-31T00:27:31.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.527+0000 7f43fb3af700 1 -- 172.21.15.77:0/2489556797 wait complete. 2023-08-31T00:27:31.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17bd1a700 1 -- 172.21.15.77:0/3452315306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa160003a00 msgr2=0x7fa160003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/3452315306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa160003a00 0x7fa160003e20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa164009c10 tx=0x7fa160005880 comp rx=0 tx=0).stop 2023-08-31T00:27:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17a2b7700 1 -- 172.21.15.77:0/3452315306 reap_dead start 2023-08-31T00:27:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17bd1a700 1 -- 172.21.15.77:0/3452315306 shutdown_connections 2023-08-31T00:27:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17bd1a700 1 -- 172.21.15.77:0/3452315306 >> 172.21.15.77:0/3452315306 conn(0x7fa17406cbf0 msgr2=0x7fa17406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17bd1a700 1 -- 172.21.15.77:0/3452315306 shutdown_connections 2023-08-31T00:27:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.664+0000 7fa17bd1a700 1 -- 172.21.15.77:0/3452315306 wait complete. 2023-08-31T00:27:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 Processor -- start 2023-08-31T00:27:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 -- start start 2023-08-31T00:27:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa160003a00 0x7fa1741539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1740aa870 0x7fa1740c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 0x7fa17415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740c3fb0 con 0x7fa174159dd0 2023-08-31T00:27:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174153f30 con 0x7fa160003a00 2023-08-31T00:27:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17bd1a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17415a7c0 con 0x7fa1740aa870 2023-08-31T00:27:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.666+0000 7fa17a2b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 0x7fa17415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 0x7fa17415a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39548/0 (socket says 172.21.15.77:39548) 2023-08-31T00:27:31.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 -- 172.21.15.77:0/185872095 learned_addr learned my addr 172.21.15.77:0/185872095 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:31.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa179ab6700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa160003a00 0x7fa1741539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa1792b5700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1740aa870 0x7fa1740c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 -- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1740aa870 msgr2=0x7fa1740c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1740aa870 0x7fa1740c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 -- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa160003a00 msgr2=0x7fa1741539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa160003a00 0x7fa1741539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 -- 172.21.15.77:0/185872095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740c4940 con 0x7fa174159dd0 2023-08-31T00:27:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17a2b7700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 0x7fa17415a280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa16c006120 tx=0x7fa16c00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c019070 con 0x7fa174159dd0 2023-08-31T00:27:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa16c00f040 con 0x7fa174159dd0 2023-08-31T00:27:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1740aad50 con 0x7fa174159dd0 2023-08-31T00:27:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c00e040 con 0x7fa174159dd0 2023-08-31T00:27:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.667+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1740ab310 con 0x7fa174159dd0 2023-08-31T00:27:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.668+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa174073c30 con 0x7fa174159dd0 2023-08-31T00:27:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.668+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa16c003a00 con 0x7fa174159dd0 2023-08-31T00:27:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.669+0000 7fa16a7fc700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa15806a0e0 0x7fa15806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.669+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa16c087f40 con 0x7fa174159dd0 2023-08-31T00:27:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.669+0000 7fa179ab6700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa15806a0e0 0x7fa15806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.669+0000 7fa179ab6700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa15806a0e0 0x7fa15806c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa164009c10 tx=0x7fa164004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.673+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa16c0537b0 con 0x7fa174159dd0 2023-08-31T00:27:31.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.864+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1740ade20 con 0x7fa174159dd0 2023-08-31T00:27:31.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.864+0000 7fa16a7fc700 1 -- 172.21.15.77:0/185872095 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa16c003cb0 con 0x7fa174159dd0 2023-08-31T00:27:31.865 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:31.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa15806a0e0 msgr2=0x7fa15806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa15806a0e0 0x7fa15806c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa164009c10 tx=0x7fa164004750 comp rx=0 tx=0).stop 2023-08-31T00:27:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 msgr2=0x7fa17415a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 0x7fa17415a280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa16c006120 tx=0x7fa16c00f490 comp rx=0 tx=0).stop 2023-08-31T00:27:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 shutdown_connections 2023-08-31T00:27:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa15806a0e0 0x7fa15806c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa174159dd0 0x7fa17415a280 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa160003a00 0x7fa1741539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 --2- 172.21.15.77:0/185872095 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1740aa870 0x7fa1740c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.866+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 >> 172.21.15.77:0/185872095 conn(0x7fa17406cbf0 msgr2=0x7fa174158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.867+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 shutdown_connections 2023-08-31T00:27:31.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:31.867+0000 7fa17bd1a700 1 -- 172.21.15.77:0/185872095 wait complete. 2023-08-31T00:27:31.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.005+0000 7fd24b5d3700 1 -- 172.21.15.77:0/3627841450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 msgr2=0x7fd2440b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.005+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/3627841450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 0x7fd2440b10a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009fd0 tx=0x7fd23c00b380 comp rx=0 tx=0).stop 2023-08-31T00:27:32.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.005+0000 7fd24b5d3700 1 -- 172.21.15.77:0/3627841450 shutdown_connections 2023-08-31T00:27:32.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.005+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/3627841450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 0x7fd2440b10a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.005+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/3627841450 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2440cb3c0 0x7fd2440b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.005+0000 7fd24b5d3700 1 -- 172.21.15.77:0/3627841450 >> 172.21.15.77:0/3627841450 conn(0x7fd244069b10 msgr2=0x7fd244069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:32.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.006+0000 7fd24b5d3700 1 -- 172.21.15.77:0/3627841450 shutdown_connections 2023-08-31T00:27:32.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.006+0000 7fd24b5d3700 1 -- 172.21.15.77:0/3627841450 wait complete. 2023-08-31T00:27:32.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.007+0000 7fd24b5d3700 1 Processor -- start 2023-08-31T00:27:32.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.007+0000 7fd24b5d3700 1 -- start start 2023-08-31T00:27:32.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24b5d3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 0x7fd244151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24b5d3700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2440cb3c0 0x7fd244154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24b5d3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 0x7fd24406b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24b5d3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2441f2510 con 0x7fd244159260 2023-08-31T00:27:32.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24b5d3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2441f1c10 con 0x7fd2440b0c10 2023-08-31T00:27:32.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24b5d3700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244155040 con 0x7fd2440cb3c0 2023-08-31T00:27:32.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd249b70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 0x7fd24406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd249b70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 0x7fd24406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39562/0 (socket says 172.21.15.77:39562) 2023-08-31T00:27:32.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd249b70700 1 -- 172.21.15.77:0/1047019657 learned_addr learned my addr 172.21.15.77:0/1047019657 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:32.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd24936f700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 0x7fd244151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.008+0000 7fd248b6e700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2440cb3c0 0x7fd244154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd249b70700 1 -- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2440cb3c0 msgr2=0x7fd244154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd249b70700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2440cb3c0 0x7fd244154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd249b70700 1 -- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 msgr2=0x7fd244151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd249b70700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 0x7fd244151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd249b70700 1 -- 172.21.15.77:0/1047019657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c009d00 con 0x7fd244159260 2023-08-31T00:27:32.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd249b70700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 0x7fd24406b700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd2440d0270 tx=0x7fd23c007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00e040 con 0x7fd244159260 2023-08-31T00:27:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd23c00be90 con 0x7fd244159260 2023-08-31T00:27:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2441f1ec0 con 0x7fd244159260 2023-08-31T00:27:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c01db90 con 0x7fd244159260 2023-08-31T00:27:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.009+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2441519b0 con 0x7fd244159260 2023-08-31T00:27:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.010+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2441f2680 con 0x7fd244159260 2023-08-31T00:27:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.011+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd23c01dcf0 con 0x7fd244159260 2023-08-31T00:27:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.011+0000 7fd239ffb700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd22806a0e0 0x7fd22806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.011+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd23c08a4c0 con 0x7fd244159260 2023-08-31T00:27:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.011+0000 7fd24936f700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd22806a0e0 0x7fd22806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.011+0000 7fd24936f700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd22806a0e0 0x7fd22806c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd240001620 tx=0x7fd240009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:32.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.015+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd23c055cb0 con 0x7fd244159260 2023-08-31T00:27:32.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.204+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd244073c30 con 0x7fd244159260 2023-08-31T00:27:32.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.204+0000 7fd239ffb700 1 -- 172.21.15.77:0/1047019657 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd23c0592d0 con 0x7fd244159260 2023-08-31T00:27:32.204 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:32.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd22806a0e0 msgr2=0x7fd22806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd22806a0e0 0x7fd22806c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd240001620 tx=0x7fd240009040 comp rx=0 tx=0).stop 2023-08-31T00:27:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 msgr2=0x7fd24406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 0x7fd24406b700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd2440d0270 tx=0x7fd23c007be0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 shutdown_connections 2023-08-31T00:27:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd22806a0e0 0x7fd22806c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd244159260 0x7fd24406b700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2440b0c10 0x7fd244151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 --2- 172.21.15.77:0/1047019657 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2440cb3c0 0x7fd244154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.206+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 >> 172.21.15.77:0/1047019657 conn(0x7fd244069b10 msgr2=0x7fd2440c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.207+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 shutdown_connections 2023-08-31T00:27:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.207+0000 7fd24b5d3700 1 -- 172.21.15.77:0/1047019657 wait complete. 2023-08-31T00:27:32.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T00:27:32.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 -- 172.21.15.77:0/708610184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 msgr2=0x7f68340acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 --2- 172.21.15.77:0/708610184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 0x7f68340acdc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f682c009f60 tx=0x7f682c009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:32.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 -- 172.21.15.77:0/708610184 shutdown_connections 2023-08-31T00:27:32.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 --2- 172.21.15.77:0/708610184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 0x7f68340acdc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 --2- 172.21.15.77:0/708610184 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f683406b230 0x7f683415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 -- 172.21.15.77:0/708610184 >> 172.21.15.77:0/708610184 conn(0x7f6834070270 msgr2=0x7f6834070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 -- 172.21.15.77:0/708610184 shutdown_connections 2023-08-31T00:27:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.347+0000 7f683ad59700 1 -- 172.21.15.77:0/708610184 wait complete. 2023-08-31T00:27:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.348+0000 7f683ad59700 1 Processor -- start 2023-08-31T00:27:32.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.348+0000 7f683ad59700 1 -- start start 2023-08-31T00:27:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f683ad59700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f683406b230 0x7f68341576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f683ad59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 0x7f6834158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f683ad59700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 0x7f68341536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f683ad59700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834159a20 con 0x7f683415b730 2023-08-31T00:27:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f683ad59700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683415a2c0 con 0x7f6834070d90 2023-08-31T00:27:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f683ad59700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6834157cc0 con 0x7f683406b230 2023-08-31T00:27:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 0x7f68341536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 0x7f68341536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39576/0 (socket says 172.21.15.77:39576) 2023-08-31T00:27:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 -- 172.21.15.77:0/1747036520 learned_addr learned my addr 172.21.15.77:0/1747036520 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f6833fff700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 0x7f6834158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f6838af5700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f683406b230 0x7f68341576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 -- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f683406b230 msgr2=0x7f68341576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f683406b230 0x7f68341576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 -- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 msgr2=0x7f6834158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 0x7f6834158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 -- 172.21.15.77:0/1747036520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200095f0 con 0x7f683415b730 2023-08-31T00:27:32.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.349+0000 7f68392f6700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 0x7f68341536d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f683406fc50 tx=0x7f682c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:32.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.350+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00e040 con 0x7f683415b730 2023-08-31T00:27:32.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.350+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f682c003c00 con 0x7f683415b730 2023-08-31T00:27:32.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.350+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c009c40 con 0x7f683415b730 2023-08-31T00:27:32.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.350+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00bbd0 con 0x7f683415b730 2023-08-31T00:27:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.350+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834159f50 con 0x7f683415b730 2023-08-31T00:27:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.351+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6834073c30 con 0x7f683415b730 2023-08-31T00:27:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.351+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f682c004030 con 0x7f683415b730 2023-08-31T00:27:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.351+0000 7f68317fa700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f681806a110 0x7f681806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.351+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f682c08a0e0 con 0x7f683415b730 2023-08-31T00:27:32.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.351+0000 7f6838af5700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f681806a110 0x7f681806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.352+0000 7f6838af5700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f681806a110 0x7f681806c5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6828001790 tx=0x7f6828009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:32.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.356+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f682c0558d0 con 0x7f683415b730 2023-08-31T00:27:32.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.550+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6834065c80 con 0x7f683415b730 2023-08-31T00:27:32.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.555+0000 7f68317fa700 1 -- 172.21.15.77:0/1747036520 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f682c058ef0 con 0x7f683415b730 2023-08-31T00:27:32.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f681806a110 msgr2=0x7f681806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f681806a110 0x7f681806c5d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6828001790 tx=0x7f6828009040 comp rx=0 tx=0).stop 2023-08-31T00:27:32.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 msgr2=0x7f68341536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 0x7f68341536d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f683406fc50 tx=0x7f682c007ed0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 shutdown_connections 2023-08-31T00:27:32.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f681806a110 0x7f681806c5d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f683406b230 0x7f68341576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f683415b730 0x7f68341536d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.557+0000 7f683ad59700 1 --2- 172.21.15.77:0/1747036520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6834070d90 0x7f6834158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.558+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 >> 172.21.15.77:0/1747036520 conn(0x7f6834070270 msgr2=0x7f683406d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:32.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.558+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 shutdown_connections 2023-08-31T00:27:32.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.558+0000 7f683ad59700 1 -- 172.21.15.77:0/1747036520 wait complete. 2023-08-31T00:27:32.569 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T00:27:32.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T00:27:32.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T00:27:32.668 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T00:27:32.669 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:27:32.669 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:32.687 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:27:32.687 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:32.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:32.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 -- 172.21.15.77:0/2037727989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76bc004850 msgr2=0x7f76bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2037727989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76bc004850 0x7f76bc004cd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f76cc006fd0 tx=0x7f76bc005880 comp rx=0 tx=0).stop 2023-08-31T00:27:32.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 -- 172.21.15.77:0/2037727989 shutdown_connections 2023-08-31T00:27:32.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2037727989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76bc004850 0x7f76bc004cd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 -- 172.21.15.77:0/2037727989 >> 172.21.15.77:0/2037727989 conn(0x7f76d00afbf0 msgr2=0x7f76d00b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:32.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 -- 172.21.15.77:0/2037727989 shutdown_connections 2023-08-31T00:27:32.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.908+0000 7f76d7a86700 1 -- 172.21.15.77:0/2037727989 wait complete. 2023-08-31T00:27:32.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.909+0000 7f76d7a86700 1 Processor -- start 2023-08-31T00:27:32.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.909+0000 7f76d7a86700 1 -- start start 2023-08-31T00:27:32.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d7a86700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76bc004850 0x7f76d01503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d7a86700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 0x7f76d00c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d7a86700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d00c7be0 0x7f76d00c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d7a86700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00c8430 con 0x7f76d01f3970 2023-08-31T00:27:32.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d7a86700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d01f34e0 con 0x7f76d00c7be0 2023-08-31T00:27:32.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d7a86700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00c8150 con 0x7f76bc004850 2023-08-31T00:27:32.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 0x7f76d00c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 0x7f76d00c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39594/0 (socket says 172.21.15.77:39594) 2023-08-31T00:27:32.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 -- 172.21.15.77:0/2497462241 learned_addr learned my addr 172.21.15.77:0/2497462241 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:32.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d6023700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d00c7be0 0x7f76d00c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5822700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76bc004850 0x7f76d01503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 -- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76bc004850 msgr2=0x7f76d01503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76bc004850 0x7f76d01503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 -- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d00c7be0 msgr2=0x7f76d00c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:32.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d00c7be0 0x7f76d00c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:32.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 -- 172.21.15.77:0/2497462241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d01f2e90 con 0x7f76d01f3970 2023-08-31T00:27:32.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.910+0000 7f76d5021700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 0x7f76d00c76a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f76cc014040 tx=0x7f76cc006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:32.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.911+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc010690 con 0x7f76d01f3970 2023-08-31T00:27:32.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.911+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f76cc0108e0 con 0x7f76d01f3970 2023-08-31T00:27:32.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.911+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc010cd0 con 0x7f76d01f3970 2023-08-31T00:27:32.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.911+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d01f3170 con 0x7f76d01f3970 2023-08-31T00:27:32.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.911+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d00af520 con 0x7f76d01f3970 2023-08-31T00:27:32.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.911+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d01f2cf0 con 0x7f76d01f3970 2023-08-31T00:27:32.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.912+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76cc01b440 con 0x7f76d01f3970 2023-08-31T00:27:32.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.912+0000 7f76c67fc700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f76b406a0e0 0x7f76b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:32.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.912+0000 7f76d5822700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f76b406a0e0 0x7f76b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:32.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.913+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76cc0895c0 con 0x7f76d01f3970 2023-08-31T00:27:32.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.913+0000 7f76d5822700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f76b406a0e0 0x7f76b406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f76c0000c00 tx=0x7f76c0006040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:32.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:32.917+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f76d01f2cf0 con 0x7f76d01f3970 2023-08-31T00:27:33.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.109+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76d01f2cf0 con 0x7f76d01f3970 2023-08-31T00:27:33.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.110+0000 7f76c67fc700 1 -- 172.21.15.77:0/2497462241 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f76d01f2cf0 con 0x7f76d01f3970 2023-08-31T00:27:33.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:33.110 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:33.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f76b406a0e0 msgr2=0x7f76b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f76b406a0e0 0x7f76b406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f76c0000c00 tx=0x7f76c0006040 comp rx=0 tx=0).stop 2023-08-31T00:27:33.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 msgr2=0x7f76d00c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 0x7f76d00c76a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f76cc014040 tx=0x7f76cc006420 comp rx=0 tx=0).stop 2023-08-31T00:27:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 shutdown_connections 2023-08-31T00:27:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f76b406a0e0 0x7f76b406c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f76bc004850 0x7f76d01503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f76d00c7be0 0x7f76d00c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 --2- 172.21.15.77:0/2497462241 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76d01f3970 0x7f76d00c76a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 >> 172.21.15.77:0/2497462241 conn(0x7f76d00afbf0 msgr2=0x7f76d00c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:33.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 shutdown_connections 2023-08-31T00:27:33.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.112+0000 7f76d7a86700 1 -- 172.21.15.77:0/2497462241 wait complete. 2023-08-31T00:27:33.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:33.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.252+0000 7fe712265700 1 -- 172.21.15.77:0/587559759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b1fc0 msgr2=0x7fe70c15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.252+0000 7fe712265700 1 --2- 172.21.15.77:0/587559759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c15d870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0098c0 tx=0x7fe6fc009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.252+0000 7fe712265700 1 -- 172.21.15.77:0/587559759 shutdown_connections 2023-08-31T00:27:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.252+0000 7fe712265700 1 --2- 172.21.15.77:0/587559759 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe70c159260 0x7fe70c0cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.252+0000 7fe712265700 1 --2- 172.21.15.77:0/587559759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c15d870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.252+0000 7fe712265700 1 -- 172.21.15.77:0/587559759 >> 172.21.15.77:0/587559759 conn(0x7fe70c069b10 msgr2=0x7fe70c069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.253+0000 7fe712265700 1 -- 172.21.15.77:0/587559759 shutdown_connections 2023-08-31T00:27:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.253+0000 7fe712265700 1 -- 172.21.15.77:0/587559759 wait complete. 2023-08-31T00:27:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.254+0000 7fe712265700 1 Processor -- start 2023-08-31T00:27:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.254+0000 7fe712265700 1 -- start start 2023-08-31T00:27:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b0c10 0x7fe70c151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe70c159260 0x7fe70c1e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1e5140 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1e5660 con 0x7fe70c0b0c10 2023-08-31T00:27:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1e3390 con 0x7fe70c159260 2023-08-31T00:27:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39608/0 (socket says 172.21.15.77:39608) 2023-08-31T00:27:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 -- 172.21.15.77:0/1066913754 learned_addr learned my addr 172.21.15.77:0/1066913754 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe710802700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe70c159260 0x7fe70c1e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70bfff700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b0c10 0x7fe70c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 -- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe70c159260 msgr2=0x7fe70c1e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe70c159260 0x7fe70c1e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 -- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b0c10 msgr2=0x7fe70c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b0c10 0x7fe70c151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 -- 172.21.15.77:0/1066913754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009520 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe70b7fe700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c150a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009230 tx=0x7fe6fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc025070 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c1e2dd0 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe6fc0058e0 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc01b040 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.255+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c1e5890 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.256+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c073c30 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.257+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6fc00fcf0 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.257+0000 7fe708ff9700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe6f806a0e0 0x7fe6f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.257+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6fc089fb0 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.257+0000 7fe70bfff700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe6f806a0e0 0x7fe6f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.258+0000 7fe70bfff700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe6f806a0e0 0x7fe6f806c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe70c1e6090 tx=0x7fe700009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:33.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.262+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe6fc0bc990 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.450+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe70c0cc3d0 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.451+0000 7fe708ff9700 1 -- 172.21.15.77:0/1066913754 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6fc0557a0 con 0x7fe70c0b1fc0 2023-08-31T00:27:33.451 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe6f806a0e0 msgr2=0x7fe6f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe6f806a0e0 0x7fe6f806c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe70c1e6090 tx=0x7fe700009260 comp rx=0 tx=0).stop 2023-08-31T00:27:33.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 msgr2=0x7fe70c150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c150a70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009230 tx=0x7fe6fc00f690 comp rx=0 tx=0).stop 2023-08-31T00:27:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 shutdown_connections 2023-08-31T00:27:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe6f806a0e0 0x7fe6f806c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe70c159260 0x7fe70c1e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe70c0b0c10 0x7fe70c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 --2- 172.21.15.77:0/1066913754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe70c0b1fc0 0x7fe70c150a70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 >> 172.21.15.77:0/1066913754 conn(0x7fe70c069b10 msgr2=0x7fe70c0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 shutdown_connections 2023-08-31T00:27:33.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.453+0000 7fe712265700 1 -- 172.21.15.77:0/1066913754 wait complete. 2023-08-31T00:27:33.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:33.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 -- 172.21.15.77:0/3072879303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 msgr2=0x7fbf5c070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3072879303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c070ac0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c071d50 tx=0x7fbf50009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 -- 172.21.15.77:0/3072879303 shutdown_connections 2023-08-31T00:27:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3072879303 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 0x7fbf5c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3072879303 >> v2:172.21.15.139:3300/0 conn(0x7fbf5c1580f0 0x7fbf5c0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3072879303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c070ac0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 -- 172.21.15.77:0/3072879303 >> 172.21.15.77:0/3072879303 conn(0x7fbf5c06cbf0 msgr2=0x7fbf5c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:33.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 -- 172.21.15.77:0/3072879303 shutdown_connections 2023-08-31T00:27:33.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.593+0000 7fbf60acf700 1 -- 172.21.15.77:0/3072879303 wait complete. 2023-08-31T00:27:33.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 Processor -- start 2023-08-31T00:27:33.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 -- start start 2023-08-31T00:27:33.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c1f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 0x7fbf5c0c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf5c1580f0 0x7fbf5c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c1f2c70 con 0x7fbf5c06f130 2023-08-31T00:27:33.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c156d00 con 0x7fbf5c1580f0 2023-08-31T00:27:33.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf60acf700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c1f2f10 con 0x7fbf5c071000 2023-08-31T00:27:33.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf5a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c1f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf5a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c1f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39620/0 (socket says 172.21.15.77:39620) 2023-08-31T00:27:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.595+0000 7fbf5a59c700 1 -- 172.21.15.77:0/3217157260 learned_addr learned my addr 172.21.15.77:0/3217157260 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf59d9b700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 0x7fbf5c0c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5ad9d700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf5c1580f0 0x7fbf5c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5a59c700 1 -- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 msgr2=0x7fbf5c0c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5a59c700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 0x7fbf5c0c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5a59c700 1 -- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf5c1580f0 msgr2=0x7fbf5c150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5a59c700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf5c1580f0 0x7fbf5c150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5a59c700 1 -- 172.21.15.77:0/3217157260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf500095f0 con 0x7fbf5c06f130 2023-08-31T00:27:33.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf59d9b700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 0x7fbf5c0c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:33.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf5a59c700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c1f3710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00d950 tx=0x7fbf4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:33.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c009930 con 0x7fbf5c06f130 2023-08-31T00:27:33.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf4c009b80 con 0x7fbf5c06f130 2023-08-31T00:27:33.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c1f31f0 con 0x7fbf5c06f130 2023-08-31T00:27:33.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c010460 con 0x7fbf5c06f130 2023-08-31T00:27:33.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.596+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c156590 con 0x7fbf5c06f130 2023-08-31T00:27:33.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.597+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c073c30 con 0x7fbf5c06f130 2023-08-31T00:27:33.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.597+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf4c0105c0 con 0x7fbf5c06f130 2023-08-31T00:27:33.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.598+0000 7fbf4affd700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbf3c06a0e0 0x7fbf3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.598+0000 7fbf59d9b700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbf3c06a0e0 0x7fbf3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.598+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf4c0886c0 con 0x7fbf5c06f130 2023-08-31T00:27:33.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.598+0000 7fbf59d9b700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbf3c06a0e0 0x7fbf3c06c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf500098e0 tx=0x7fbf500047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:33.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.602+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf4c053ea0 con 0x7fbf5c06f130 2023-08-31T00:27:33.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.794+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf5c158520 con 0x7fbf5c06f130 2023-08-31T00:27:33.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.795+0000 7fbf4affd700 1 -- 172.21.15.77:0/3217157260 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf4c0574c0 con 0x7fbf5c06f130 2023-08-31T00:27:33.795 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbf3c06a0e0 msgr2=0x7fbf3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbf3c06a0e0 0x7fbf3c06c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf500098e0 tx=0x7fbf500047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 msgr2=0x7fbf5c1f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c1f3710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00d950 tx=0x7fbf4c00dc60 comp rx=0 tx=0).stop 2023-08-31T00:27:33.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 shutdown_connections 2023-08-31T00:27:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fbf3c06a0e0 0x7fbf3c06c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf5c1580f0 0x7fbf5c150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf5c06f130 0x7fbf5c1f3710 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 --2- 172.21.15.77:0/3217157260 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbf5c071000 0x7fbf5c0c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 >> 172.21.15.77:0/3217157260 conn(0x7fbf5c06cbf0 msgr2=0x7fbf5c0c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 shutdown_connections 2023-08-31T00:27:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.797+0000 7fbf60acf700 1 -- 172.21.15.77:0/3217157260 wait complete. 2023-08-31T00:27:33.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d6a94700 1 -- 172.21.15.77:0/2922845864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c0004850 msgr2=0x7f81c0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d6a94700 1 --2- 172.21.15.77:0/2922845864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81c0004850 0x7f81c0004cd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c2e0 tx=0x7f81c0005880 comp rx=0 tx=0).stop 2023-08-31T00:27:33.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d5031700 1 -- 172.21.15.77:0/2922845864 reap_dead start 2023-08-31T00:27:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d6a94700 1 -- 172.21.15.77:0/2922845864 shutdown_connections 2023-08-31T00:27:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d6a94700 1 -- 172.21.15.77:0/2922845864 >> 172.21.15.77:0/2922845864 conn(0x7f81d006cbf0 msgr2=0x7f81d006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d6a94700 1 -- 172.21.15.77:0/2922845864 shutdown_connections 2023-08-31T00:27:33.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.935+0000 7f81d6a94700 1 -- 172.21.15.77:0/2922845864 wait complete. 2023-08-31T00:27:33.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.936+0000 7f81d6a94700 1 Processor -- start 2023-08-31T00:27:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.936+0000 7f81d6a94700 1 -- start start 2023-08-31T00:27:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81c0004850 0x7f81d00aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 0x7f81d0069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81d006a050 0x7f81d00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d01545b0 con 0x7f81d0152500 2023-08-31T00:27:33.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c74d0 con 0x7f81d006a050 2023-08-31T00:27:33.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0152980 con 0x7f81c0004850 2023-08-31T00:27:33.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 0x7f81d0069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 0x7f81d0069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39642/0 (socket says 172.21.15.77:39642) 2023-08-31T00:27:33.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 -- 172.21.15.77:0/1036121625 learned_addr learned my addr 172.21.15.77:0/1036121625 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:33.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d4830700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81c0004850 0x7f81d00aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d5031700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81d006a050 0x7f81d00c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 -- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81c0004850 msgr2=0x7f81d00aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81c0004850 0x7f81d00aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 -- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81d006a050 msgr2=0x7f81d00c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:33.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81d006a050 0x7f81d00c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:33.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 -- 172.21.15.77:0/1036121625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d006a890 con 0x7f81d0152500 2023-08-31T00:27:33.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d5031700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81d006a050 0x7f81d00c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:33.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cffff700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 0x7f81d0069b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f81bc001930 tx=0x7f81bc00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:33.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc003680 con 0x7f81d0152500 2023-08-31T00:27:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f81bc0037e0 con 0x7f81d0152500 2023-08-31T00:27:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d006a5b0 con 0x7f81d0152500 2023-08-31T00:27:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.937+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc003bf0 con 0x7f81d0152500 2023-08-31T00:27:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.938+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d01541d0 con 0x7f81d0152500 2023-08-31T00:27:33.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.939+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0073c30 con 0x7f81d0152500 2023-08-31T00:27:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.939+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81bc022070 con 0x7f81d0152500 2023-08-31T00:27:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.939+0000 7f81cd7fa700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f81b406a0e0 0x7f81b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.939+0000 7f81d4830700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f81b406a0e0 0x7f81b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.939+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81bc08a430 con 0x7f81d0152500 2023-08-31T00:27:33.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.940+0000 7f81d4830700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f81b406a0e0 0x7f81b406c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009b20 tx=0x7f81c4009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:33.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:33.944+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f81bc055dc0 con 0x7f81d0152500 2023-08-31T00:27:34.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.131+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81d015ade0 con 0x7f81d0152500 2023-08-31T00:27:34.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.132+0000 7f81cd7fa700 1 -- 172.21.15.77:0/1036121625 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81bc0593e0 con 0x7f81d0152500 2023-08-31T00:27:34.132 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f81b406a0e0 msgr2=0x7f81b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f81b406a0e0 0x7f81b406c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009b20 tx=0x7f81c4009260 comp rx=0 tx=0).stop 2023-08-31T00:27:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 msgr2=0x7f81d0069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 0x7f81d0069b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f81bc001930 tx=0x7f81bc00cf00 comp rx=0 tx=0).stop 2023-08-31T00:27:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 shutdown_connections 2023-08-31T00:27:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f81b406a0e0 0x7f81b406c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f81c0004850 0x7f81d00aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81d006a050 0x7f81d00c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 --2- 172.21.15.77:0/1036121625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d0152500 0x7f81d0069b10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 >> 172.21.15.77:0/1036121625 conn(0x7f81d006cbf0 msgr2=0x7f81d0159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:34.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 shutdown_connections 2023-08-31T00:27:34.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.134+0000 7f81d6a94700 1 -- 172.21.15.77:0/1036121625 wait complete. 2023-08-31T00:27:34.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:34.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 -- 172.21.15.77:0/3894137820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d4071000 msgr2=0x7fd6d415bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 --2- 172.21.15.77:0/3894137820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d4071000 0x7fd6d415bd40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40cbba0 tx=0x7fd6cc00b380 comp rx=0 tx=0).stop 2023-08-31T00:27:34.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 -- 172.21.15.77:0/3894137820 shutdown_connections 2023-08-31T00:27:34.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 --2- 172.21.15.77:0/3894137820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d4071000 0x7fd6d415bd40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 --2- 172.21.15.77:0/3894137820 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6d41580f0 0x7fd6d40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 --2- 172.21.15.77:0/3894137820 >> v2:172.21.15.139:3300/0 conn(0x7fd6d406f130 0x7fd6d4070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 -- 172.21.15.77:0/3894137820 >> 172.21.15.77:0/3894137820 conn(0x7fd6d406cbf0 msgr2=0x7fd6d406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:34.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 -- 172.21.15.77:0/3894137820 shutdown_connections 2023-08-31T00:27:34.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.270+0000 7fd6daad4700 1 -- 172.21.15.77:0/3894137820 wait complete. 2023-08-31T00:27:34.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.271+0000 7fd6daad4700 1 Processor -- start 2023-08-31T00:27:34.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.271+0000 7fd6daad4700 1 -- start start 2023-08-31T00:27:34.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6d406f130 0x7fd6d414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6d4071000 0x7fd6d414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 0x7fd6d40ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c9720 con 0x7fd6d41580f0 2023-08-31T00:27:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c99e0 con 0x7fd6d4071000 2023-08-31T00:27:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c9cc0 con 0x7fd6d406f130 2023-08-31T00:27:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 0x7fd6d40ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 0x7fd6d40ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39658/0 (socket says 172.21.15.77:39658) 2023-08-31T00:27:34.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 -- 172.21.15.77:0/4002323376 learned_addr learned my addr 172.21.15.77:0/4002323376 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:34.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d8870700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6d406f130 0x7fd6d414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d3fff700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6d4071000 0x7fd6d414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 -- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6d406f130 msgr2=0x7fd6d414c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6d406f130 0x7fd6d414c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 -- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6d4071000 msgr2=0x7fd6d414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6d4071000 0x7fd6d414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 -- 172.21.15.77:0/4002323376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc009d00 con 0x7fd6d41580f0 2023-08-31T00:27:34.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d9071700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 0x7fd6d40ca7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6d406c500 tx=0x7fd6cc007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:34.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00e040 con 0x7fd6d41580f0 2023-08-31T00:27:34.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd6cc01d680 con 0x7fd6d41580f0 2023-08-31T00:27:34.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d40c9fa0 con 0x7fd6d41580f0 2023-08-31T00:27:34.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.272+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc01dad0 con 0x7fd6d41580f0 2023-08-31T00:27:34.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.273+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d414a8d0 con 0x7fd6d41580f0 2023-08-31T00:27:34.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.273+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40ca4c0 con 0x7fd6d41580f0 2023-08-31T00:27:34.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.274+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd6cc01dc30 con 0x7fd6d41580f0 2023-08-31T00:27:34.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.274+0000 7fd6d17fa700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd6b806a0e0 0x7fd6b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.274+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6cc08a4d0 con 0x7fd6d41580f0 2023-08-31T00:27:34.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.274+0000 7fd6d8870700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd6b806a0e0 0x7fd6b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.275+0000 7fd6d8870700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd6b806a0e0 0x7fd6b806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005950 tx=0x7fd6c8005f90 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:34.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.279+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd6d40ca4c0 con 0x7fd6d41580f0 2023-08-31T00:27:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.483+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6d40ca4c0 con 0x7fd6d41580f0 2023-08-31T00:27:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.483+0000 7fd6d17fa700 1 -- 172.21.15.77:0/4002323376 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6d40ca4c0 con 0x7fd6d41580f0 2023-08-31T00:27:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd6b806a0e0 msgr2=0x7fd6b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd6b806a0e0 0x7fd6b806c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005950 tx=0x7fd6c8005f90 comp rx=0 tx=0).stop 2023-08-31T00:27:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 msgr2=0x7fd6d40ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 0x7fd6d40ca7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd6d406c500 tx=0x7fd6cc007b60 comp rx=0 tx=0).stop 2023-08-31T00:27:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 shutdown_connections 2023-08-31T00:27:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd6b806a0e0 0x7fd6b806c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd6d406f130 0x7fd6d414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6d41580f0 0x7fd6d40ca7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 --2- 172.21.15.77:0/4002323376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6d4071000 0x7fd6d414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 >> 172.21.15.77:0/4002323376 conn(0x7fd6d406cbf0 msgr2=0x7fd6d41518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 shutdown_connections 2023-08-31T00:27:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.485+0000 7fd6daad4700 1 -- 172.21.15.77:0/4002323376 wait complete. 2023-08-31T00:27:34.488 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:34.496 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:27:34.497 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:34.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:34.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 -- 172.21.15.77:0/4034425710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba415bce0 msgr2=0x7f6ba415c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/4034425710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba415bce0 0x7f6ba415c140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009f60 tx=0x7f6b9c009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 -- 172.21.15.77:0/4034425710 shutdown_connections 2023-08-31T00:27:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/4034425710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba415bce0 0x7f6ba415c140 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/4034425710 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ba406e3c0 0x7f6ba406e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 -- 172.21.15.77:0/4034425710 >> 172.21.15.77:0/4034425710 conn(0x7f6ba40afbf0 msgr2=0x7f6ba40b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:34.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 -- 172.21.15.77:0/4034425710 shutdown_connections 2023-08-31T00:27:34.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.678+0000 7f6baa8b0700 1 -- 172.21.15.77:0/4034425710 wait complete. 2023-08-31T00:27:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.679+0000 7f6baa8b0700 1 Processor -- start 2023-08-31T00:27:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 -- start start 2023-08-31T00:27:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 0x7f6ba40c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba4158210 0x7f6ba414c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ba415bce0 0x7f6ba40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414ca50 con 0x7f6ba406e3c0 2023-08-31T00:27:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c5920 con 0x7f6ba4158210 2023-08-31T00:27:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6baa8b0700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40c5c00 con 0x7f6ba415bce0 2023-08-31T00:27:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6ba3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 0x7f6ba40c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6ba3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 0x7f6ba40c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39670/0 (socket says 172.21.15.77:39670) 2023-08-31T00:27:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.680+0000 7f6ba3fff700 1 -- 172.21.15.77:0/2597724480 learned_addr learned my addr 172.21.15.77:0/2597724480 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba37fe700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba4158210 0x7f6ba414c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba8e4d700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ba415bce0 0x7f6ba40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba3fff700 1 -- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ba415bce0 msgr2=0x7f6ba40c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba3fff700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ba415bce0 0x7f6ba40c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba3fff700 1 -- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba4158210 msgr2=0x7f6ba414c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba3fff700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba4158210 0x7f6ba414c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba3fff700 1 -- 172.21.15.77:0/2597724480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009520 con 0x7f6ba406e3c0 2023-08-31T00:27:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba3fff700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 0x7f6ba40c7b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c500 tx=0x7f6b9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b94004230 con 0x7f6ba406e3c0 2023-08-31T00:27:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b940044a0 con 0x7f6ba406e3c0 2023-08-31T00:27:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c009c40 con 0x7f6ba406e3c0 2023-08-31T00:27:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b940038e0 con 0x7f6ba406e3c0 2023-08-31T00:27:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.681+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba40c61c0 con 0x7f6ba406e3c0 2023-08-31T00:27:34.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.682+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4073c30 con 0x7f6ba406e3c0 2023-08-31T00:27:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.682+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b94003a40 con 0x7f6ba406e3c0 2023-08-31T00:27:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.683+0000 7f6ba0ff9700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6b9006a0e0 0x7f6b9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.683+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b94087b70 con 0x7f6ba406e3c0 2023-08-31T00:27:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.683+0000 7f6ba37fe700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6b9006a0e0 0x7f6b9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:34.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.683+0000 7f6ba37fe700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6b9006a0e0 0x7f6b9006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4072bc0 tx=0x7f6b98009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:34.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.687+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6b94053410 con 0x7f6ba406e3c0 2023-08-31T00:27:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.879+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba40cb930 con 0x7f6ba406e3c0 2023-08-31T00:27:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.880+0000 7f6ba0ff9700 1 -- 172.21.15.77:0/2597724480 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f6b94017020 con 0x7f6ba406e3c0 2023-08-31T00:27:34.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:34.881 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.882+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6b9006a0e0 msgr2=0x7f6b9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.882+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6b9006a0e0 0x7f6b9006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4072bc0 tx=0x7f6b98009260 comp rx=0 tx=0).stop 2023-08-31T00:27:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 msgr2=0x7f6ba40c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 0x7f6ba40c7b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c500 tx=0x7f6b9400c8c0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 shutdown_connections 2023-08-31T00:27:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6b9006a0e0 0x7f6b9006c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6ba415bce0 0x7f6ba40c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ba406e3c0 0x7f6ba40c7b50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 --2- 172.21.15.77:0/2597724480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ba4158210 0x7f6ba414c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:34.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 >> 172.21.15.77:0/2597724480 conn(0x7f6ba40afbf0 msgr2=0x7f6ba4070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:34.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 shutdown_connections 2023-08-31T00:27:34.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:34.883+0000 7f6baa8b0700 1 -- 172.21.15.77:0/2597724480 wait complete. 2023-08-31T00:27:34.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:34.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:35.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.020+0000 7fc83385d700 1 -- 172.21.15.77:0/2894854192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c0b3240 msgr2=0x7fc82c0b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.020+0000 7fc83385d700 1 --2- 172.21.15.77:0/2894854192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c0b3240 0x7fc82c0b5d70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc824009f60 tx=0x7fc824009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:35.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.020+0000 7fc83385d700 1 -- 172.21.15.77:0/2894854192 shutdown_connections 2023-08-31T00:27:35.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.020+0000 7fc83385d700 1 --2- 172.21.15.77:0/2894854192 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c0b3240 0x7fc82c0b5d70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.020+0000 7fc83385d700 1 -- 172.21.15.77:0/2894854192 >> 172.21.15.77:0/2894854192 conn(0x7fc82c071630 msgr2=0x7fc82c071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:35.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.021+0000 7fc83385d700 1 -- 172.21.15.77:0/2894854192 shutdown_connections 2023-08-31T00:27:35.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.021+0000 7fc83385d700 1 -- 172.21.15.77:0/2894854192 wait complete. 2023-08-31T00:27:35.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 Processor -- start 2023-08-31T00:27:35.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 -- start start 2023-08-31T00:27:35.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc82c0b2d90 0x7fc82c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc82c0b3240 0x7fc82c0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 0x7fc82c0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0c5ee0 con 0x7fc82c15b490 2023-08-31T00:27:35.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0c94d0 con 0x7fc82c0b2d90 2023-08-31T00:27:35.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc83385d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0c9730 con 0x7fc82c0b3240 2023-08-31T00:27:35.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.022+0000 7fc831dfa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 0x7fc82c0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 0x7fc82c0c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39686/0 (socket says 172.21.15.77:39686) 2023-08-31T00:27:35.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 -- 172.21.15.77:0/1976051426 learned_addr learned my addr 172.21.15.77:0/1976051426 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:35.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc830df8700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc82c0b3240 0x7fc82c0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc8315f9700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc82c0b2d90 0x7fc82c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 -- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc82c0b3240 msgr2=0x7fc82c0c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc82c0b3240 0x7fc82c0c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 -- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc82c0b2d90 msgr2=0x7fc82c14f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc82c0b2d90 0x7fc82c14f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 -- 172.21.15.77:0/1976051426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009c40 con 0x7fc82c15b490 2023-08-31T00:27:35.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc830df8700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc82c0b3240 0x7fc82c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:35.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc831dfa700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 0x7fc82c0c8f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0cf560 tx=0x7fc824007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:35.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82400e040 con 0x7fc82c15b490 2023-08-31T00:27:35.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc82401d680 con 0x7fc82c15b490 2023-08-31T00:27:35.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c0c9a10 con 0x7fc82c15b490 2023-08-31T00:27:35.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82401da50 con 0x7fc82c15b490 2023-08-31T00:27:35.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.023+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c0c9fd0 con 0x7fc82c15b490 2023-08-31T00:27:35.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.024+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c073c30 con 0x7fc82c15b490 2023-08-31T00:27:35.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.025+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc82401dbb0 con 0x7fc82c15b490 2023-08-31T00:27:35.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.025+0000 7fc821ffb700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc81006a0e0 0x7fc81006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.025+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc82408a540 con 0x7fc82c15b490 2023-08-31T00:27:35.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.025+0000 7fc8315f9700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc81006a0e0 0x7fc81006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.025+0000 7fc8315f9700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc81006a0e0 0x7fc81006c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc828004740 tx=0x7fc828007f40 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:35.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.029+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc824055db0 con 0x7fc82c15b490 2023-08-31T00:27:35.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.220+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc82c0ceee0 con 0x7fc82c15b490 2023-08-31T00:27:35.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.220+0000 7fc821ffb700 1 -- 172.21.15.77:0/1976051426 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc82401de60 con 0x7fc82c15b490 2023-08-31T00:27:35.221 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:35.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc81006a0e0 msgr2=0x7fc81006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc81006a0e0 0x7fc81006c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc828004740 tx=0x7fc828007f40 comp rx=0 tx=0).stop 2023-08-31T00:27:35.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 msgr2=0x7fc82c0c8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 0x7fc82c0c8f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0cf560 tx=0x7fc824007ac0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 shutdown_connections 2023-08-31T00:27:35.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc81006a0e0 0x7fc81006c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc82c15b490 0x7fc82c0c8f90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc82c0b2d90 0x7fc82c14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 --2- 172.21.15.77:0/1976051426 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc82c0b3240 0x7fc82c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.222+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 >> 172.21.15.77:0/1976051426 conn(0x7fc82c071630 msgr2=0x7fc82c150490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:35.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.223+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 shutdown_connections 2023-08-31T00:27:35.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.223+0000 7fc83385d700 1 -- 172.21.15.77:0/1976051426 wait complete. 2023-08-31T00:27:35.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 -- 172.21.15.77:0/3351320968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb01580f0 msgr2=0x7f8fb00cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/3351320968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb01580f0 0x7f8fb00cc250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00098c0 tx=0x7f8fa0009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 -- 172.21.15.77:0/3351320968 shutdown_connections 2023-08-31T00:27:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/3351320968 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 0x7f8fb00c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/3351320968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb01580f0 0x7f8fb00cc250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 -- 172.21.15.77:0/3351320968 >> 172.21.15.77:0/3351320968 conn(0x7f8fb006cbf0 msgr2=0x7f8fb006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 -- 172.21.15.77:0/3351320968 shutdown_connections 2023-08-31T00:27:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.361+0000 7f8fb7e07700 1 -- 172.21.15.77:0/3351320968 wait complete. 2023-08-31T00:27:35.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.362+0000 7f8fb7e07700 1 Processor -- start 2023-08-31T00:27:35.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.362+0000 7f8fb7e07700 1 -- start start 2023-08-31T00:27:35.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb7e07700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb006f130 0x7f8fb00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb7e07700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 0x7f8fb00a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb7e07700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 0x7f8fb00a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb7e07700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00a7750 con 0x7f8fb01580f0 2023-08-31T00:27:35.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb7e07700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00a6b40 con 0x7f8fb006f130 2023-08-31T00:27:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb7e07700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00a6e20 con 0x7f8fb00711d0 2023-08-31T00:27:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 0x7f8fb00a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 0x7f8fb00a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39698/0 (socket says 172.21.15.77:39698) 2023-08-31T00:27:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 -- 172.21.15.77:0/1106755918 learned_addr learned my addr 172.21.15.77:0/1106755918 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:35.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb5ba3700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb006f130 0x7f8fb00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb53a2700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 0x7f8fb00a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 -- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 msgr2=0x7f8fb00a6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 0x7f8fb00a6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 -- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb006f130 msgr2=0x7f8fb00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb006f130 0x7f8fb00c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 -- 172.21.15.77:0/1106755918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009520 con 0x7f8fb01580f0 2023-08-31T00:27:35.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb53a2700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 0x7f8fb00a6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:35.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.363+0000 7f8fb63a4700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 0x7f8fb00a7be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009fd0 tx=0x7f8fa800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:35.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.364+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8018070 con 0x7f8fb01580f0 2023-08-31T00:27:35.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.364+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8fa800f040 con 0x7f8fb01580f0 2023-08-31T00:27:35.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.364+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb00a7100 con 0x7f8fb01580f0 2023-08-31T00:27:35.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.364+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8004bb0 con 0x7f8fb01580f0 2023-08-31T00:27:35.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.364+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb00a8120 con 0x7f8fb01580f0 2023-08-31T00:27:35.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.364+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0073c30 con 0x7f8fb01580f0 2023-08-31T00:27:35.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.365+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8fa800c9e0 con 0x7f8fb01580f0 2023-08-31T00:27:35.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.365+0000 7f8fa67fc700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8f9406a0e0 0x7f8f9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.365+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fa8088470 con 0x7f8fb01580f0 2023-08-31T00:27:35.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.365+0000 7f8fb5ba3700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8f9406a0e0 0x7f8f9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.366+0000 7f8fb5ba3700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8f9406a0e0 0x7f8f9406c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c00 tx=0x7f8fa0011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:35.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.370+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8fa8053c60 con 0x7f8fb01580f0 2023-08-31T00:27:35.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.558+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fb00aed60 con 0x7f8fb01580f0 2023-08-31T00:27:35.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.559+0000 7f8fa67fc700 1 -- 172.21.15.77:0/1106755918 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fa8057280 con 0x7f8fb01580f0 2023-08-31T00:27:35.559 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:35.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.560+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8f9406a0e0 msgr2=0x7f8f9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.560+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8f9406a0e0 0x7f8f9406c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c00 tx=0x7f8fa0011040 comp rx=0 tx=0).stop 2023-08-31T00:27:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.560+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 msgr2=0x7f8fb00a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.560+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 0x7f8fb00a7be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009fd0 tx=0x7f8fa800ef90 comp rx=0 tx=0).stop 2023-08-31T00:27:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 shutdown_connections 2023-08-31T00:27:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8f9406a0e0 0x7f8f9406c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01580f0 0x7f8fb00a7be0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb006f130 0x7f8fb00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 --2- 172.21.15.77:0/1106755918 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fb00711d0 0x7f8fb00a6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 >> 172.21.15.77:0/1106755918 conn(0x7f8fb006cbf0 msgr2=0x7f8fb01588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:35.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 shutdown_connections 2023-08-31T00:27:35.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.561+0000 7f8fb7e07700 1 -- 172.21.15.77:0/1106755918 wait complete. 2023-08-31T00:27:35.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:35.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4021145913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 msgr2=0x7f0b780c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4021145913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b780c91f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0b740098c0 tx=0x7f0b74009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4021145913 shutdown_connections 2023-08-31T00:27:35.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4021145913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b780c91f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4021145913 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7806e3c0 0x7f0b7806e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4021145913 >> 172.21.15.77:0/4021145913 conn(0x7f0b780afbf0 msgr2=0x7f0b780b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:35.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4021145913 shutdown_connections 2023-08-31T00:27:35.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.699+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4021145913 wait complete. 2023-08-31T00:27:35.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.700+0000 7f0b7ff70700 1 Processor -- start 2023-08-31T00:27:35.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.700+0000 7f0b7ff70700 1 -- start start 2023-08-31T00:27:35.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7ff70700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b7806e3c0 0x7f0b781f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7ff70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b78069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7ff70700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7815bce0 0x7f0b7806a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7ff70700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780c8460 con 0x7f0b78158210 2023-08-31T00:27:35.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7ff70700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78148260 con 0x7f0b7806e3c0 2023-08-31T00:27:35.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7ff70700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78148540 con 0x7f0b7815bce0 2023-08-31T00:27:35.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b78069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b78069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39708/0 (socket says 172.21.15.77:39708) 2023-08-31T00:27:35.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 -- 172.21.15.77:0/4072420991 learned_addr learned my addr 172.21.15.77:0/4072420991 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:35.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7dd0c700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b7806e3c0 0x7f0b781f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 -- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7815bce0 msgr2=0x7f0b7806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7e50d700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7815bce0 0x7f0b7806a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7815bce0 0x7f0b7806a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 -- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b7806e3c0 msgr2=0x7f0b781f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.701+0000 7f0b7d50b700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b7806e3c0 0x7f0b781f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b7d50b700 1 -- 172.21.15.77:0/4072420991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009520 con 0x7f0b78158210 2023-08-31T00:27:35.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b7dd0c700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b7806e3c0 0x7f0b781f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:35.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b7e50d700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7815bce0 0x7f0b7806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:35.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b7d50b700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b78069b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800b530 tx=0x7f0b6800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:35.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011830 con 0x7f0b78158210 2023-08-31T00:27:35.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0b68011aa0 con 0x7f0b78158210 2023-08-31T00:27:35.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b78148820 con 0x7f0b78158210 2023-08-31T00:27:35.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68010380 con 0x7f0b78158210 2023-08-31T00:27:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.702+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b781f2a40 con 0x7f0b78158210 2023-08-31T00:27:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.703+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b78148d40 con 0x7f0b78158210 2023-08-31T00:27:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.703+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b680104e0 con 0x7f0b78158210 2023-08-31T00:27:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.704+0000 7f0b6e7fc700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0b5c06a0e0 0x7f0b5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.704+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b68088740 con 0x7f0b78158210 2023-08-31T00:27:35.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.704+0000 7f0b7dd0c700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0b5c06a0e0 0x7f0b5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:35.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.704+0000 7f0b7dd0c700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0b5c06a0e0 0x7f0b5c06c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009230 tx=0x7f0b740047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:35.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.708+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b78148d40 con 0x7f0b78158210 2023-08-31T00:27:35.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.897+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b78148d40 con 0x7f0b78158210 2023-08-31T00:27:35.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.897+0000 7f0b6e7fc700 1 -- 172.21.15.77:0/4072420991 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b78148d40 con 0x7f0b78158210 2023-08-31T00:27:35.898 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:35.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0b5c06a0e0 msgr2=0x7f0b5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0b5c06a0e0 0x7f0b5c06c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009230 tx=0x7f0b740047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 msgr2=0x7f0b78069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:35.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b78069b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800b530 tx=0x7f0b6800b8f0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 shutdown_connections 2023-08-31T00:27:35.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0b5c06a0e0 0x7f0b5c06c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0b7815bce0 0x7f0b7806a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b7806e3c0 0x7f0b781f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 --2- 172.21.15.77:0/4072420991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b78158210 0x7f0b78069b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:35.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 >> 172.21.15.77:0/4072420991 conn(0x7f0b780afbf0 msgr2=0x7f0b780c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:35.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 shutdown_connections 2023-08-31T00:27:35.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:35.899+0000 7f0b7ff70700 1 -- 172.21.15.77:0/4072420991 wait complete. 2023-08-31T00:27:35.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.035+0000 7f047612c700 1 -- 172.21.15.77:0/3543756529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0470159530 msgr2=0x7f04700c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.035+0000 7f047612c700 1 --2- 172.21.15.77:0/3543756529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0470159530 0x7f04700c97d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0470073600 tx=0x7f0464009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.036+0000 7f047612c700 1 -- 172.21.15.77:0/3543756529 shutdown_connections 2023-08-31T00:27:36.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.036+0000 7f047612c700 1 --2- 172.21.15.77:0/3543756529 >> v2:172.21.15.139:3300/0 conn(0x7f047015a020 0x7f04700c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.036+0000 7f047612c700 1 --2- 172.21.15.77:0/3543756529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0470159530 0x7f04700c97d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.036+0000 7f047612c700 1 -- 172.21.15.77:0/3543756529 >> 172.21.15.77:0/3543756529 conn(0x7f04700cf180 msgr2=0x7f04700cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.036+0000 7f047612c700 1 -- 172.21.15.77:0/3543756529 shutdown_connections 2023-08-31T00:27:36.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.036+0000 7f047612c700 1 -- 172.21.15.77:0/3543756529 wait complete. 2023-08-31T00:27:36.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.037+0000 7f047612c700 1 Processor -- start 2023-08-31T00:27:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.037+0000 7f047612c700 1 -- start start 2023-08-31T00:27:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0470159530 0x7f0470157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 0x7f04700a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f047015dc10 0x7f04700a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700a6500 con 0x7f047015a020 2023-08-31T00:27:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700a67e0 con 0x7f0470159530 2023-08-31T00:27:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700a6ac0 con 0x7f047015dc10 2023-08-31T00:27:36.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 0x7f04700a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 0x7f04700a75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39722/0 (socket says 172.21.15.77:39722) 2023-08-31T00:27:36.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 -- 172.21.15.77:0/1784462350 learned_addr learned my addr 172.21.15.77:0/1784462350 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:36.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046f7fe700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0470159530 0x7f0470157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046ffff700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f047015dc10 0x7f04700a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 -- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f047015dc10 msgr2=0x7f04700a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f047015dc10 0x7f04700a7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 -- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0470159530 msgr2=0x7f0470157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0470159530 0x7f0470157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 -- 172.21.15.77:0/1784462350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640095f0 con 0x7f047015a020 2023-08-31T00:27:36.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046f7fe700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0470159530 0x7f0470157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:36.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046ffff700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f047015dc10 0x7f04700a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:36.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f046effd700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 0x7f04700a75a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f046000b4a0 tx=0x7f046000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:36.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460011830 con 0x7f047015a020 2023-08-31T00:27:36.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0460011a80 con 0x7f047015a020 2023-08-31T00:27:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04700a6da0 con 0x7f047015a020 2023-08-31T00:27:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460011e90 con 0x7f047015a020 2023-08-31T00:27:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.038+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04701efab0 con 0x7f047015a020 2023-08-31T00:27:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.039+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0470073c30 con 0x7f047015a020 2023-08-31T00:27:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.040+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f046001a400 con 0x7f047015a020 2023-08-31T00:27:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.040+0000 7f0457fff700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f045c06a0e0 0x7f045c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.040+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0460088410 con 0x7f047015a020 2023-08-31T00:27:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.040+0000 7f046f7fe700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f045c06a0e0 0x7f045c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.041+0000 7f046f7fe700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f045c06a0e0 0x7f045c06c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04640098e0 tx=0x7f04640047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:36.048 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.045+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0460053b60 con 0x7f047015a020 2023-08-31T00:27:36.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.252+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04701430d0 con 0x7f047015a020 2023-08-31T00:27:36.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.252+0000 7f0457fff700 1 -- 172.21.15.77:0/1784462350 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0460014170 con 0x7f047015a020 2023-08-31T00:27:36.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f045c06a0e0 msgr2=0x7f045c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f045c06a0e0 0x7f045c06c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04640098e0 tx=0x7f04640047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 msgr2=0x7f04700a75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 0x7f04700a75a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f046000b4a0 tx=0x7f046000b860 comp rx=0 tx=0).stop 2023-08-31T00:27:36.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 shutdown_connections 2023-08-31T00:27:36.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f045c06a0e0 0x7f045c06c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f047015dc10 0x7f04700a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0470159530 0x7f0470157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 --2- 172.21.15.77:0/1784462350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f047015a020 0x7f04700a75a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 >> 172.21.15.77:0/1784462350 conn(0x7f04700cf180 msgr2=0x7f04700b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:36.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 shutdown_connections 2023-08-31T00:27:36.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.255+0000 7f047612c700 1 -- 172.21.15.77:0/1784462350 wait complete. 2023-08-31T00:27:36.257 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:36.266 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-08-31T00:27:36.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:36.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-31T00:27:36.311 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:36.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:27:36.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:36.312 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T00:27:36.372 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:27:36.372 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:36.393 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:27:36.394 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:36.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:36.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 -- 172.21.15.77:0/3189757716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc0711d0 msgr2=0x7f64fc0c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 --2- 172.21.15.77:0/3189757716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc0711d0 0x7f64fc0c96b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f64fc071d50 tx=0x7f64f400b380 comp rx=0 tx=0).stop 2023-08-31T00:27:36.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 -- 172.21.15.77:0/3189757716 shutdown_connections 2023-08-31T00:27:36.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 --2- 172.21.15.77:0/3189757716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc0711d0 0x7f64fc0c96b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 --2- 172.21.15.77:0/3189757716 >> v2:172.21.15.139:3300/0 conn(0x7f64fc1580f0 0x7f64fc0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 -- 172.21.15.77:0/3189757716 >> 172.21.15.77:0/3189757716 conn(0x7f64fc06cbf0 msgr2=0x7f64fc06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:36.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 -- 172.21.15.77:0/3189757716 shutdown_connections 2023-08-31T00:27:36.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.577+0000 7f6502d0e700 1 -- 172.21.15.77:0/3189757716 wait complete. 2023-08-31T00:27:36.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.578+0000 7f6502d0e700 1 Processor -- start 2023-08-31T00:27:36.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 -- start start 2023-08-31T00:27:36.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64fc06f130 0x7f64fc1ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc0711d0 0x7f64fc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 0x7f64fc155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0a68d0 con 0x7f64fc1580f0 2023-08-31T00:27:36.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0a6bb0 con 0x7f64fc06f130 2023-08-31T00:27:36.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f6502d0e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0a6e90 con 0x7f64fc0711d0 2023-08-31T00:27:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.579+0000 7f65012ab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 0x7f64fc155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 0x7f64fc155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39736/0 (socket says 172.21.15.77:39736) 2023-08-31T00:27:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 -- 172.21.15.77:0/2552587885 learned_addr learned my addr 172.21.15.77:0/2552587885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:36.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f6500aaa700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64fc06f130 0x7f64fc1ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f64fbfff700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc0711d0 0x7f64fc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 -- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc0711d0 msgr2=0x7f64fc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc0711d0 0x7f64fc155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 -- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64fc06f130 msgr2=0x7f64fc1ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64fc06f130 0x7f64fc1ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 -- 172.21.15.77:0/2552587885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f4009d00 con 0x7f64fc1580f0 2023-08-31T00:27:36.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f6500aaa700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64fc06f130 0x7f64fc1ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:36.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f65012ab700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 0x7f64fc155d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f64f4012000 tx=0x7f64f4007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:36.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f400e040 con 0x7f64fc1580f0 2023-08-31T00:27:36.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64f401d8b0 con 0x7f64fc1580f0 2023-08-31T00:27:36.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0a7170 con 0x7f64fc1580f0 2023-08-31T00:27:36.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f401dd00 con 0x7f64fc1580f0 2023-08-31T00:27:36.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.580+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc1eecb0 con 0x7f64fc1580f0 2023-08-31T00:27:36.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.581+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc0a7360 con 0x7f64fc1580f0 2023-08-31T00:27:36.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.582+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64f401b450 con 0x7f64fc1580f0 2023-08-31T00:27:36.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.582+0000 7f64f97fa700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f64e006a0e0 0x7f64e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.582+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64f408a310 con 0x7f64fc1580f0 2023-08-31T00:27:36.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.582+0000 7f6500aaa700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f64e006a0e0 0x7f64e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.582+0000 7f6500aaa700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f64e006a0e0 0x7f64e006c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009c10 tx=0x7f64f0009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:36.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.586+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f64f4055b80 con 0x7f64fc1580f0 2023-08-31T00:27:36.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.775+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64fc073c30 con 0x7f64fc1580f0 2023-08-31T00:27:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.776+0000 7f64f97fa700 1 -- 172.21.15.77:0/2552587885 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f64f400be60 con 0x7f64fc1580f0 2023-08-31T00:27:36.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:36.777 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:36.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f64e006a0e0 msgr2=0x7f64e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f64e006a0e0 0x7f64e006c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009c10 tx=0x7f64f0009260 comp rx=0 tx=0).stop 2023-08-31T00:27:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 msgr2=0x7f64fc155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 0x7f64fc155d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f64f4012000 tx=0x7f64f4007c90 comp rx=0 tx=0).stop 2023-08-31T00:27:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 shutdown_connections 2023-08-31T00:27:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f64e006a0e0 0x7f64e006c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64fc1580f0 0x7f64fc155d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64fc06f130 0x7f64fc1ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.778+0000 7f6502d0e700 1 --2- 172.21.15.77:0/2552587885 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f64fc0711d0 0x7f64fc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.779+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 >> 172.21.15.77:0/2552587885 conn(0x7f64fc06cbf0 msgr2=0x7f64fc1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.779+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 shutdown_connections 2023-08-31T00:27:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.779+0000 7f6502d0e700 1 -- 172.21.15.77:0/2552587885 wait complete. 2023-08-31T00:27:36.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:36.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.917+0000 7f1e686bc700 1 -- 172.21.15.77:0/1614732539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 msgr2=0x7f1e600c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.917+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1614732539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e600c97d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1e600cfe70 tx=0x7f1e50009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.917+0000 7f1e686bc700 1 -- 172.21.15.77:0/1614732539 shutdown_connections 2023-08-31T00:27:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.917+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1614732539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e600c97d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.917+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1614732539 >> v2:172.21.15.139:3300/0 conn(0x7f1e6015dc10 0x7f1e600c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.917+0000 7f1e686bc700 1 -- 172.21.15.77:0/1614732539 >> 172.21.15.77:0/1614732539 conn(0x7f1e600cf180 msgr2=0x7f1e600cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:36.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.918+0000 7f1e686bc700 1 -- 172.21.15.77:0/1614732539 shutdown_connections 2023-08-31T00:27:36.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.918+0000 7f1e686bc700 1 -- 172.21.15.77:0/1614732539 wait complete. 2023-08-31T00:27:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 Processor -- start 2023-08-31T00:27:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 -- start start 2023-08-31T00:27:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e601f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e60159910 0x7f1e600b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6015dc10 0x7f1e60157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6015abd0 con 0x7f1e60159530 2023-08-31T00:27:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600b43a0 con 0x7f1e6015dc10 2023-08-31T00:27:36.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e686bc700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600b4680 con 0x7f1e60159910 2023-08-31T00:27:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.919+0000 7f1e66458700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e601f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e601f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39746/0 (socket says 172.21.15.77:39746) 2023-08-31T00:27:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 -- 172.21.15.77:0/1081959111 learned_addr learned my addr 172.21.15.77:0/1081959111 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 -- 172.21.15.77:0/1081959111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e60159910 msgr2=0x7f1e600b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e60159910 0x7f1e600b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 -- 172.21.15.77:0/1081959111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6015dc10 msgr2=0x7f1e60157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6015dc10 0x7f1e60157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 -- 172.21.15.77:0/1081959111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50009520 con 0x7f1e60159530 2023-08-31T00:27:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e66458700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e601f17b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1e50000c00 tx=0x7f1e5000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:36.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e50025070 con 0x7f1e60159530 2023-08-31T00:27:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1e5000fc70 con 0x7f1e60159530 2023-08-31T00:27:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e600b4960 con 0x7f1e60159530 2023-08-31T00:27:36.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5001b040 con 0x7f1e60159530 2023-08-31T00:27:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.920+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e600b4f20 con 0x7f1e60159530 2023-08-31T00:27:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.921+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e60073c30 con 0x7f1e60159530 2023-08-31T00:27:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.921+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e5002a410 con 0x7f1e60159530 2023-08-31T00:27:36.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.922+0000 7f1e56ffd700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1e4406a0e0 0x7f1e4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.922+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e5008a160 con 0x7f1e60159530 2023-08-31T00:27:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.922+0000 7f1e65c57700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1e4406a0e0 0x7f1e4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.922+0000 7f1e65c57700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1e4406a0e0 0x7f1e4406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c005950 tx=0x7f1e5c0058e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:36.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:36.926+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1e500559d0 con 0x7f1e60159530 2023-08-31T00:27:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.113+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e600cff90 con 0x7f1e60159530 2023-08-31T00:27:37.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.114+0000 7f1e56ffd700 1 -- 172.21.15.77:0/1081959111 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e50058ff0 con 0x7f1e60159530 2023-08-31T00:27:37.117 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1e4406a0e0 msgr2=0x7f1e4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1e4406a0e0 0x7f1e4406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c005950 tx=0x7f1e5c0058e0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 msgr2=0x7f1e601f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e601f17b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1e50000c00 tx=0x7f1e5000f7c0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 shutdown_connections 2023-08-31T00:27:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1e4406a0e0 0x7f1e4406c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e6015dc10 0x7f1e60157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e60159530 0x7f1e601f17b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 --2- 172.21.15.77:0/1081959111 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1e60159910 0x7f1e600b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 >> 172.21.15.77:0/1081959111 conn(0x7f1e600cf180 msgr2=0x7f1e60154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 shutdown_connections 2023-08-31T00:27:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.116+0000 7f1e686bc700 1 -- 172.21.15.77:0/1081959111 wait complete. 2023-08-31T00:27:37.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:37.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 -- 172.21.15.77:0/2874175720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c159530 msgr2=0x7f4c4c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/2874175720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c159530 0x7f4c4c0c97d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c073600 tx=0x7f4c48009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:37.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 -- 172.21.15.77:0/2874175720 shutdown_connections 2023-08-31T00:27:37.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/2874175720 >> v2:172.21.15.139:3300/0 conn(0x7f4c4c15a020 0x7f4c4c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/2874175720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c159530 0x7f4c4c0c97d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 -- 172.21.15.77:0/2874175720 >> 172.21.15.77:0/2874175720 conn(0x7f4c4c0cf180 msgr2=0x7f4c4c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:37.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 -- 172.21.15.77:0/2874175720 shutdown_connections 2023-08-31T00:27:37.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.254+0000 7f4c53a8a700 1 -- 172.21.15.77:0/2874175720 wait complete. 2023-08-31T00:27:37.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.255+0000 7f4c53a8a700 1 Processor -- start 2023-08-31T00:27:37.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.255+0000 7f4c53a8a700 1 -- start start 2023-08-31T00:27:37.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c53a8a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4c4c159530 0x7f4c4c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c53a8a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 0x7f4c4c0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c53a8a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c4c15dc10 0x7f4c4c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c53a8a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0c8aa0 con 0x7f4c4c15a020 2023-08-31T00:27:37.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c53a8a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0a6960 con 0x7f4c4c15dc10 2023-08-31T00:27:37.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c53a8a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0c8450 con 0x7f4c4c159530 2023-08-31T00:27:37.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 0x7f4c4c0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 0x7f4c4c0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39762/0 (socket says 172.21.15.77:39762) 2023-08-31T00:27:37.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 -- 172.21.15.77:0/954622976 learned_addr learned my addr 172.21.15.77:0/954622976 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:37.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51826700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4c4c159530 0x7f4c4c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c52027700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c4c15dc10 0x7f4c4c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 -- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4c4c159530 msgr2=0x7f4c4c1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4c4c159530 0x7f4c4c1570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 -- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c4c15dc10 msgr2=0x7f4c4c0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c4c15dc10 0x7f4c4c0c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51025700 1 -- 172.21.15.77:0/954622976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480095f0 con 0x7f4c4c15a020 2023-08-31T00:27:37.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.256+0000 7f4c51826700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4c4c159530 0x7f4c4c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:37.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.257+0000 7f4c51025700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 0x7f4c4c0c4180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c450 tx=0x7f4c3c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:37.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.257+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0052d0 con 0x7f4c4c15a020 2023-08-31T00:27:37.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.257+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c3c005520 con 0x7f4c4c15a020 2023-08-31T00:27:37.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.257+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c0c8730 con 0x7f4c4c15a020 2023-08-31T00:27:37.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.257+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0038e0 con 0x7f4c4c15a020 2023-08-31T00:27:37.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.257+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c0a6460 con 0x7f4c4c15a020 2023-08-31T00:27:37.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.258+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c0c8c10 con 0x7f4c4c15a020 2023-08-31T00:27:37.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.258+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c3c003a40 con 0x7f4c4c15a020 2023-08-31T00:27:37.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.258+0000 7f4c427fc700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4c3006a0e0 0x7f4c3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.259+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c3c087790 con 0x7f4c4c15a020 2023-08-31T00:27:37.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.259+0000 7f4c51826700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4c3006a0e0 0x7f4c3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.259+0000 7f4c51826700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4c3006a0e0 0x7f4c3006c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c48000c00 tx=0x7f4c480047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:37.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.263+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4c3c053000 con 0x7f4c4c15a020 2023-08-31T00:27:37.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.452+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c4c15a450 con 0x7f4c4c15a020 2023-08-31T00:27:37.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.452+0000 7f4c427fc700 1 -- 172.21.15.77:0/954622976 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c4c15a450 con 0x7f4c4c15a020 2023-08-31T00:27:37.453 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:37.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4c3006a0e0 msgr2=0x7f4c3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4c3006a0e0 0x7f4c3006c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c48000c00 tx=0x7f4c480047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 msgr2=0x7f4c4c0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 0x7f4c4c0c4180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c450 tx=0x7f4c3c00c810 comp rx=0 tx=0).stop 2023-08-31T00:27:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 shutdown_connections 2023-08-31T00:27:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f4c3006a0e0 0x7f4c3006c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4c4c159530 0x7f4c4c1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c4c15dc10 0x7f4c4c0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 --2- 172.21.15.77:0/954622976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c4c15a020 0x7f4c4c0c4180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 >> 172.21.15.77:0/954622976 conn(0x7f4c4c0cf180 msgr2=0x7f4c4c157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 shutdown_connections 2023-08-31T00:27:37.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.454+0000 7f4c53a8a700 1 -- 172.21.15.77:0/954622976 wait complete. 2023-08-31T00:27:37.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:37.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.592+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/3837974291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 msgr2=0x7f6d4806ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.592+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/3837974291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 0x7f6d4806ab20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d38005fd0 tx=0x7f6d38009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:37.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.592+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/3837974291 shutdown_connections 2023-08-31T00:27:37.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.592+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/3837974291 >> v2:172.21.15.139:3300/0 conn(0x7f6d4806b060 0x7f6d480cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.592+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/3837974291 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 0x7f6d4806ab20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.592+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/3837974291 >> 172.21.15.77:0/3837974291 conn(0x7f6d48070270 msgr2=0x7f6d48070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:37.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.593+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/3837974291 shutdown_connections 2023-08-31T00:27:37.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.593+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/3837974291 wait complete. 2023-08-31T00:27:37.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 Processor -- start 2023-08-31T00:27:37.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 -- start start 2023-08-31T00:27:37.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 0x7f6d481449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 0x7f6d48147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d480ace10 0x7f6d48147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48145b80 con 0x7f6d4806b060 2023-08-31T00:27:37.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48144f00 con 0x7f6d480ace10 2023-08-31T00:27:37.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.594+0000 7f6d4f8fd700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48145290 con 0x7f6d4806e6e0 2023-08-31T00:27:37.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 0x7f6d481449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 0x7f6d481449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39774/0 (socket says 172.21.15.77:39774) 2023-08-31T00:27:37.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 -- 172.21.15.77:0/1369287248 learned_addr learned my addr 172.21.15.77:0/1369287248 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:37.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4ce98700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 0x7f6d48147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4de9a700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d480ace10 0x7f6d48147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 -- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 msgr2=0x7f6d48147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 0x7f6d48147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 -- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d480ace10 msgr2=0x7f6d48147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d480ace10 0x7f6d48147780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 -- 172.21.15.77:0/1369287248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009c40 con 0x7f6d4806b060 2023-08-31T00:27:37.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4d699700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 0x7f6d481449c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400c430 tx=0x7f6d4400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:37.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440052d0 con 0x7f6d4806b060 2023-08-31T00:27:37.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6d44005540 con 0x7f6d4806b060 2023-08-31T00:27:37.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d380095f0 con 0x7f6d4806b060 2023-08-31T00:27:37.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44006aa0 con 0x7f6d4806b060 2023-08-31T00:27:37.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.595+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d48145530 con 0x7f6d4806b060 2023-08-31T00:27:37.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.596+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48073c30 con 0x7f6d4806b060 2023-08-31T00:27:37.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.597+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6d44003680 con 0x7f6d4806b060 2023-08-31T00:27:37.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.597+0000 7f6d3dffb700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6d2c06a0e0 0x7f6d2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.597+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d44087900 con 0x7f6d4806b060 2023-08-31T00:27:37.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.597+0000 7f6d4ce98700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6d2c06a0e0 0x7f6d2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.598+0000 7f6d4ce98700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6d2c06a0e0 0x7f6d2c06c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d480b1c80 tx=0x7f6d380047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:37.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.602+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6d440530e0 con 0x7f6d4806b060 2023-08-31T00:27:37.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.791+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d48065ec0 con 0x7f6d4806b060 2023-08-31T00:27:37.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.792+0000 7f6d3dffb700 1 -- 172.21.15.77:0/1369287248 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d44056700 con 0x7f6d4806b060 2023-08-31T00:27:37.793 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:37.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6d2c06a0e0 msgr2=0x7f6d2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6d2c06a0e0 0x7f6d2c06c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6d480b1c80 tx=0x7f6d380047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 msgr2=0x7f6d481449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 0x7f6d481449c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400c430 tx=0x7f6d4400c7f0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 shutdown_connections 2023-08-31T00:27:37.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6d2c06a0e0 0x7f6d2c06c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d480ace10 0x7f6d48147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d4806b060 0x7f6d481449c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 --2- 172.21.15.77:0/1369287248 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6d4806e6e0 0x7f6d48147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 >> 172.21.15.77:0/1369287248 conn(0x7f6d48070270 msgr2=0x7f6d4815b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 shutdown_connections 2023-08-31T00:27:37.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.794+0000 7f6d4f8fd700 1 -- 172.21.15.77:0/1369287248 wait complete. 2023-08-31T00:27:37.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:37.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.928+0000 7f81a1e9f700 1 -- 172.21.15.77:0/1090701788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 msgr2=0x7f819c0ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.928+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/1090701788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c0ce2b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f819c0b3320 tx=0x7f8184009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:37.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.929+0000 7f81a1e9f700 1 -- 172.21.15.77:0/1090701788 shutdown_connections 2023-08-31T00:27:37.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.929+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/1090701788 >> v2:172.21.15.139:3300/0 conn(0x7f819c0ce7f0 0x7f819c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.929+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/1090701788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c0ce2b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.929+0000 7f81a1e9f700 1 -- 172.21.15.77:0/1090701788 >> 172.21.15.77:0/1090701788 conn(0x7f819c071630 msgr2=0x7f819c071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:37.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.929+0000 7f81a1e9f700 1 -- 172.21.15.77:0/1090701788 shutdown_connections 2023-08-31T00:27:37.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.929+0000 7f81a1e9f700 1 -- 172.21.15.77:0/1090701788 wait complete. 2023-08-31T00:27:37.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.930+0000 7f81a1e9f700 1 Processor -- start 2023-08-31T00:27:37.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.930+0000 7f81a1e9f700 1 -- start start 2023-08-31T00:27:37.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f81a1e9f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f81a1e9f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f819c0ce7f0 0x7f819c1f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f81a1e9f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f819c15b3d0 0x7f819c15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f81a1e9f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c14dd10 con 0x7f819c0b04a0 2023-08-31T00:27:37.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f81a1e9f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c1f53b0 con 0x7f819c15b3d0 2023-08-31T00:27:37.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f81a1e9f700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c14d100 con 0x7f819c0ce7f0 2023-08-31T00:27:37.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f819b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f819b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c14fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39788/0 (socket says 172.21.15.77:39788) 2023-08-31T00:27:37.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.931+0000 7f819b7fe700 1 -- 172.21.15.77:0/2092791841 learned_addr learned my addr 172.21.15.77:0/2092791841 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819bfff700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f819c15b3d0 0x7f819c15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819affd700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f819c0ce7f0 0x7f819c1f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819b7fe700 1 -- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f819c0ce7f0 msgr2=0x7f819c1f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819b7fe700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f819c0ce7f0 0x7f819c1f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819b7fe700 1 -- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f819c15b3d0 msgr2=0x7f819c15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819b7fe700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f819c15b3d0 0x7f819c15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:37.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819b7fe700 1 -- 172.21.15.77:0/2092791841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840095f0 con 0x7f819c0b04a0 2023-08-31T00:27:37.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f819b7fe700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c14fc50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c550 tx=0x7f818c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:37.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0054e0 con 0x7f819c0b04a0 2023-08-31T00:27:37.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f818c003680 con 0x7f819c0b04a0 2023-08-31T00:27:37.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c14d3e0 con 0x7f819c0b04a0 2023-08-31T00:27:37.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c003a90 con 0x7f819c0b04a0 2023-08-31T00:27:37.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.932+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c14d9a0 con 0x7f819c0b04a0 2023-08-31T00:27:37.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.933+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c073c30 con 0x7f819c0b04a0 2023-08-31T00:27:37.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.934+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f818c003bf0 con 0x7f819c0b04a0 2023-08-31T00:27:37.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.934+0000 7f8193fff700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f817c06a0e0 0x7f817c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:37.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.934+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f818c087a30 con 0x7f819c0b04a0 2023-08-31T00:27:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.934+0000 7f819affd700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f817c06a0e0 0x7f817c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.934+0000 7f819affd700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f817c06a0e0 0x7f817c06c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f81840098e0 tx=0x7f81840047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:37.938+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f818c053210 con 0x7f819c0b04a0 2023-08-31T00:27:38.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.144+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f819c0b43d0 con 0x7f819c0b04a0 2023-08-31T00:27:38.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.144+0000 7f8193fff700 1 -- 172.21.15.77:0/2092791841 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f818c056830 con 0x7f819c0b04a0 2023-08-31T00:27:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f817c06a0e0 msgr2=0x7f817c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f817c06a0e0 0x7f817c06c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f81840098e0 tx=0x7f81840047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 msgr2=0x7f819c14fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c14fc50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c550 tx=0x7f818c00c910 comp rx=0 tx=0).stop 2023-08-31T00:27:38.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 shutdown_connections 2023-08-31T00:27:38.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f817c06a0e0 0x7f817c06c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f819c15b3d0 0x7f819c15dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f819c0b04a0 0x7f819c14fc50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 --2- 172.21.15.77:0/2092791841 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f819c0ce7f0 0x7f819c1f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 >> 172.21.15.77:0/2092791841 conn(0x7f819c071630 msgr2=0x7f819c15a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:38.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 shutdown_connections 2023-08-31T00:27:38.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.146+0000 7f81a1e9f700 1 -- 172.21.15.77:0/2092791841 wait complete. 2023-08-31T00:27:38.150 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:38.160 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:27:38.160 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:38.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:38.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cce991700 1 -- 172.21.15.77:0/3750566146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cb0004850 msgr2=0x7f5cb0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cce991700 1 --2- 172.21.15.77:0/3750566146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cb0004850 0x7f5cb0004cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009be0 tx=0x7f5cb0005880 comp rx=0 tx=0).stop 2023-08-31T00:27:38.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cccf2e700 1 -- 172.21.15.77:0/3750566146 reap_dead start 2023-08-31T00:27:38.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cce991700 1 -- 172.21.15.77:0/3750566146 shutdown_connections 2023-08-31T00:27:38.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cce991700 1 -- 172.21.15.77:0/3750566146 >> 172.21.15.77:0/3750566146 conn(0x7f5cc80cf180 msgr2=0x7f5cc80cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:38.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cce991700 1 -- 172.21.15.77:0/3750566146 shutdown_connections 2023-08-31T00:27:38.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.307+0000 7f5cce991700 1 -- 172.21.15.77:0/3750566146 wait complete. 2023-08-31T00:27:38.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.308+0000 7f5cce991700 1 Processor -- start 2023-08-31T00:27:38.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.308+0000 7f5cce991700 1 -- start start 2023-08-31T00:27:38.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cce991700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cb0004850 0x7f5cc8150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cce991700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 0x7f5cc80b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cce991700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5cc80b2270 0x7f5cc80b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cce991700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc806ae30 con 0x7f5cc80b4b10 2023-08-31T00:27:38.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cce991700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc81e4960 con 0x7f5cb0004850 2023-08-31T00:27:38.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cce991700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc80c34f0 con 0x7f5cc80b2270 2023-08-31T00:27:38.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cc77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 0x7f5cc80b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cc77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 0x7f5cc80b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39810/0 (socket says 172.21.15.77:39810) 2023-08-31T00:27:38.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cc77fe700 1 -- 172.21.15.77:0/1874488609 learned_addr learned my addr 172.21.15.77:0/1874488609 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:38.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cc7fff700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cb0004850 0x7f5cc8150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.309+0000 7f5cccf2e700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5cc80b2270 0x7f5cc80b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc77fe700 1 -- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5cc80b2270 msgr2=0x7f5cc80b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc77fe700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5cc80b2270 0x7f5cc80b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc77fe700 1 -- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cb0004850 msgr2=0x7f5cc8150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc77fe700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cb0004850 0x7f5cc8150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc77fe700 1 -- 172.21.15.77:0/1874488609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc80c37d0 con 0x7f5cc80b4b10 2023-08-31T00:27:38.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc7fff700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cb0004850 0x7f5cc8150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:38.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc77fe700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 0x7f5cc80b1d30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009b00 tx=0x7f5cb8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:38.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8004230 con 0x7f5cc80b4b10 2023-08-31T00:27:38.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5cb80043b0 con 0x7f5cc80b4b10 2023-08-31T00:27:38.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80038e0 con 0x7f5cc80b4b10 2023-08-31T00:27:38.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc80c3ab0 con 0x7f5cc80b4b10 2023-08-31T00:27:38.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.310+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc80b4130 con 0x7f5cc80b4b10 2023-08-31T00:27:38.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.311+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc806afa0 con 0x7f5cc80b4b10 2023-08-31T00:27:38.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.311+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5cb8003a40 con 0x7f5cc80b4b10 2023-08-31T00:27:38.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.312+0000 7f5cc4ff9700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5cb406a0e0 0x7f5cb406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.312+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cb8014070 con 0x7f5cc80b4b10 2023-08-31T00:27:38.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.312+0000 7f5cc7fff700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5cb406a0e0 0x7f5cb406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.312+0000 7f5cc7fff700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5cb406a0e0 0x7f5cb406c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009bf0 tx=0x7f5cbc009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:38.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.316+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5cb80bc990 con 0x7f5cc80b4b10 2023-08-31T00:27:38.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.507+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cc806ac20 con 0x7f5cc80b4b10 2023-08-31T00:27:38.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.508+0000 7f5cc4ff9700 1 -- 172.21.15.77:0/1874488609 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f5cb80556c0 con 0x7f5cc80b4b10 2023-08-31T00:27:38.509 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:38.509 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:38.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5cb406a0e0 msgr2=0x7f5cb406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5cb406a0e0 0x7f5cb406c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009bf0 tx=0x7f5cbc009260 comp rx=0 tx=0).stop 2023-08-31T00:27:38.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 msgr2=0x7f5cc80b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 0x7f5cc80b1d30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009b00 tx=0x7f5cb8004f90 comp rx=0 tx=0).stop 2023-08-31T00:27:38.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 shutdown_connections 2023-08-31T00:27:38.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5cb406a0e0 0x7f5cb406c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5cc80b2270 0x7f5cc80b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cb0004850 0x7f5cc8150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 --2- 172.21.15.77:0/1874488609 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5cc80b4b10 0x7f5cc80b1d30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 >> 172.21.15.77:0/1874488609 conn(0x7f5cc80cf180 msgr2=0x7f5cc8154d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:38.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 shutdown_connections 2023-08-31T00:27:38.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.510+0000 7f5cce991700 1 -- 172.21.15.77:0/1874488609 wait complete. 2023-08-31T00:27:38.523 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:38.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49ca99e700 1 -- 172.21.15.77:0/334039404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49ac005960 msgr2=0x7f49ac005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49ca99e700 1 --2- 172.21.15.77:0/334039404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49ac005960 0x7f49ac005de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f49b400bb90 tx=0x7f49ac006990 comp rx=0 tx=0).stop 2023-08-31T00:27:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49c8f3b700 1 -- 172.21.15.77:0/334039404 reap_dead start 2023-08-31T00:27:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49ca99e700 1 -- 172.21.15.77:0/334039404 shutdown_connections 2023-08-31T00:27:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49ca99e700 1 -- 172.21.15.77:0/334039404 >> 172.21.15.77:0/334039404 conn(0x7f49c4070270 msgr2=0x7f49c4070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49ca99e700 1 -- 172.21.15.77:0/334039404 shutdown_connections 2023-08-31T00:27:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.651+0000 7f49ca99e700 1 -- 172.21.15.77:0/334039404 wait complete. 2023-08-31T00:27:38.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.653+0000 7f49ca99e700 1 Processor -- start 2023-08-31T00:27:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.653+0000 7f49ca99e700 1 -- start start 2023-08-31T00:27:38.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.653+0000 7f49ca99e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49ac005960 0x7f49c4156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.653+0000 7f49ca99e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49c40c1360 0x7f49c40cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.653+0000 7f49ca99e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 0x7f49c40cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.653+0000 7f49ca99e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b0aa0 con 0x7f49c40c17e0 2023-08-31T00:27:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49ca99e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4156dc0 con 0x7f49ac005960 2023-08-31T00:27:38.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49ca99e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b0470 con 0x7f49c40c1360 2023-08-31T00:27:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 0x7f49c40cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 0x7f49c40cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39832/0 (socket says 172.21.15.77:39832) 2023-08-31T00:27:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 -- 172.21.15.77:0/1566914783 learned_addr learned my addr 172.21.15.77:0/1566914783 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c37fe700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49c40c1360 0x7f49c40cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c3fff700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49ac005960 0x7f49c4156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 -- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49c40c1360 msgr2=0x7f49c40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49c40c1360 0x7f49c40cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 -- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49ac005960 msgr2=0x7f49c4156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49ac005960 0x7f49c4156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 -- 172.21.15.77:0/1566914783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40c4240 con 0x7f49c40c17e0 2023-08-31T00:27:38.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c3fff700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49ac005960 0x7f49c4156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:38.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c8f3b700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 0x7f49c40cb940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49c40b3780 tx=0x7f49bc00eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:38.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc010890 con 0x7f49c40c17e0 2023-08-31T00:27:38.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f49bc010b00 con 0x7f49c40c17e0 2023-08-31T00:27:38.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c40c4520 con 0x7f49c40c17e0 2023-08-31T00:27:38.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc011460 con 0x7f49c40c17e0 2023-08-31T00:27:38.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.654+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c40b3470 con 0x7f49c40c17e0 2023-08-31T00:27:38.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.655+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c40b0be0 con 0x7f49c40c17e0 2023-08-31T00:27:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.656+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f49bc0115c0 con 0x7f49c40c17e0 2023-08-31T00:27:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.656+0000 7f49c0ff9700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f49b006a0e0 0x7f49b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:38.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.656+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49bc088bb0 con 0x7f49c40c17e0 2023-08-31T00:27:38.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.656+0000 7f49c3fff700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f49b006a0e0 0x7f49b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.656+0000 7f49c3fff700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f49b006a0e0 0x7f49b006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49c415b3f0 tx=0x7f49b8006c50 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:38.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.660+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f49c40b0be0 con 0x7f49c40c17e0 2023-08-31T00:27:38.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.847+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49c40b0be0 con 0x7f49c40c17e0 2023-08-31T00:27:38.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.848+0000 7f49c0ff9700 1 -- 172.21.15.77:0/1566914783 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49c40b0be0 con 0x7f49c40c17e0 2023-08-31T00:27:38.849 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:38.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f49b006a0e0 msgr2=0x7f49b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f49b006a0e0 0x7f49b006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49c415b3f0 tx=0x7f49b8006c50 comp rx=0 tx=0).stop 2023-08-31T00:27:38.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 msgr2=0x7f49c40cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 0x7f49c40cb940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49c40b3780 tx=0x7f49bc00eb60 comp rx=0 tx=0).stop 2023-08-31T00:27:38.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 shutdown_connections 2023-08-31T00:27:38.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f49b006a0e0 0x7f49b006c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49c40c17e0 0x7f49c40cb940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49ac005960 0x7f49c4156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 --2- 172.21.15.77:0/1566914783 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49c40c1360 0x7f49c40cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 >> 172.21.15.77:0/1566914783 conn(0x7f49c4070270 msgr2=0x7f49c40c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:38.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 shutdown_connections 2023-08-31T00:27:38.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.850+0000 7f49ca99e700 1 -- 172.21.15.77:0/1566914783 wait complete. 2023-08-31T00:27:38.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.989+0000 7f2398ae7700 1 -- 172.21.15.77:0/3280114977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 msgr2=0x7f2394070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.989+0000 7f2398ae7700 1 --2- 172.21.15.77:0/3280114977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394070ac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2394071d50 tx=0x7f2384009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:38.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.990+0000 7f2398ae7700 1 -- 172.21.15.77:0/3280114977 shutdown_connections 2023-08-31T00:27:38.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.990+0000 7f2398ae7700 1 --2- 172.21.15.77:0/3280114977 >> v2:172.21.15.139:3300/0 conn(0x7f23941580f0 0x7f23940cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.990+0000 7f2398ae7700 1 --2- 172.21.15.77:0/3280114977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394070ac0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:38.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.990+0000 7f2398ae7700 1 -- 172.21.15.77:0/3280114977 >> 172.21.15.77:0/3280114977 conn(0x7f239406cbf0 msgr2=0x7f239406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:38.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.990+0000 7f2398ae7700 1 -- 172.21.15.77:0/3280114977 shutdown_connections 2023-08-31T00:27:38.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.990+0000 7f2398ae7700 1 -- 172.21.15.77:0/3280114977 wait complete. 2023-08-31T00:27:38.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.991+0000 7f2398ae7700 1 Processor -- start 2023-08-31T00:27:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.991+0000 7f2398ae7700 1 -- start start 2023-08-31T00:27:38.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2394071000 0x7f2394150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23941580f0 0x7f2394154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394150dd0 con 0x7f239406f130 2023-08-31T00:27:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394157290 con 0x7f2394071000 2023-08-31T00:27:39.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2394157570 con 0x7f23941580f0 2023-08-31T00:27:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39842/0 (socket says 172.21.15.77:39842) 2023-08-31T00:27:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 -- 172.21.15.77:0/975740324 learned_addr learned my addr 172.21.15.77:0/975740324 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2391d9b700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2394071000 0x7f2394150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2392d9d700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23941580f0 0x7f2394154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 -- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23941580f0 msgr2=0x7f2394154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23941580f0 0x7f2394154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 -- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2394071000 msgr2=0x7f2394150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2394071000 0x7f2394150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 -- 172.21.15.77:0/975740324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840095f0 con 0x7f239406f130 2023-08-31T00:27:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2391d9b700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2394071000 0x7f2394150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f239259c700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394156c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f238800c970 tx=0x7f238800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388007b00 con 0x7f239406f130 2023-08-31T00:27:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2388007c60 con 0x7f239406f130 2023-08-31T00:27:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394157850 con 0x7f239406f130 2023-08-31T00:27:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388004a90 con 0x7f239406f130 2023-08-31T00:27:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.992+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23940c6e20 con 0x7f239406f130 2023-08-31T00:27:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.993+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23940c7010 con 0x7f239406f130 2023-08-31T00:27:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.994+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2388004bf0 con 0x7f239406f130 2023-08-31T00:27:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.994+0000 7f2382ffd700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f237406a0e0 0x7f237406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.994+0000 7f2391d9b700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f237406a0e0 0x7f237406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.994+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2388088700 con 0x7f239406f130 2023-08-31T00:27:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.995+0000 7f2391d9b700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f237406a0e0 0x7f237406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2384000c00 tx=0x7f23840047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:38.999+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2388053f70 con 0x7f239406f130 2023-08-31T00:27:39.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.186+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2394158550 con 0x7f239406f130 2023-08-31T00:27:39.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.186+0000 7f2382ffd700 1 -- 172.21.15.77:0/975740324 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2388057590 con 0x7f239406f130 2023-08-31T00:27:39.188 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:39.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f237406a0e0 msgr2=0x7f237406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f237406a0e0 0x7f237406c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2384000c00 tx=0x7f23840047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 msgr2=0x7f2394156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394156c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f238800c970 tx=0x7f238800cd30 comp rx=0 tx=0).stop 2023-08-31T00:27:39.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 shutdown_connections 2023-08-31T00:27:39.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f237406a0e0 0x7f237406c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23941580f0 0x7f2394154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f239406f130 0x7f2394156c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 --2- 172.21.15.77:0/975740324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2394071000 0x7f2394150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 >> 172.21.15.77:0/975740324 conn(0x7f239406cbf0 msgr2=0x7f2394152640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 shutdown_connections 2023-08-31T00:27:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.188+0000 7f2398ae7700 1 -- 172.21.15.77:0/975740324 wait complete. 2023-08-31T00:27:39.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:39.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.328+0000 7f47b3e65700 1 -- 172.21.15.77:0/1383050052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac15dc10 msgr2=0x7f47ac15a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.328+0000 7f47b3e65700 1 --2- 172.21.15.77:0/1383050052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac15dc10 0x7f47ac15a020 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009f60 tx=0x7f47a4009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:39.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.328+0000 7f47b3e65700 1 -- 172.21.15.77:0/1383050052 shutdown_connections 2023-08-31T00:27:39.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.328+0000 7f47b3e65700 1 --2- 172.21.15.77:0/1383050052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac15dc10 0x7f47ac15a020 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.328+0000 7f47b3e65700 1 -- 172.21.15.77:0/1383050052 >> 172.21.15.77:0/1383050052 conn(0x7f47ac0cf180 msgr2=0x7f47ac0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.329+0000 7f47b3e65700 1 -- 172.21.15.77:0/1383050052 shutdown_connections 2023-08-31T00:27:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.329+0000 7f47b3e65700 1 -- 172.21.15.77:0/1383050052 wait complete. 2023-08-31T00:27:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 Processor -- start 2023-08-31T00:27:39.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 -- start start 2023-08-31T00:27:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0c9ee0 0x7f47ac0c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 0x7f47ac14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47ac15dc10 0x7f47ac150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac06ca30 con 0x7f47ac159530 2023-08-31T00:27:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0c5350 con 0x7f47ac0c9ee0 2023-08-31T00:27:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.330+0000 7f47b3e65700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0c5070 con 0x7f47ac15dc10 2023-08-31T00:27:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 0x7f47ac14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 0x7f47ac14fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39858/0 (socket says 172.21.15.77:39858) 2023-08-31T00:27:39.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 -- 172.21.15.77:0/3001563963 learned_addr learned my addr 172.21.15.77:0/3001563963 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:39.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1c01700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0c9ee0 0x7f47ac0c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b2402700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47ac15dc10 0x7f47ac150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 -- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47ac15dc10 msgr2=0x7f47ac150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47ac15dc10 0x7f47ac150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 -- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0c9ee0 msgr2=0x7f47ac0c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0c9ee0 0x7f47ac0c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 -- 172.21.15.77:0/3001563963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4009c40 con 0x7f47ac159530 2023-08-31T00:27:39.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1c01700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0c9ee0 0x7f47ac0c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:39.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b2402700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47ac15dc10 0x7f47ac150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:39.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b1400700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 0x7f47ac14fb30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c500 tx=0x7f479c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:39.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c004230 con 0x7f47ac159530 2023-08-31T00:27:39.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f479c0044a0 con 0x7f47ac159530 2023-08-31T00:27:39.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac06c3e0 con 0x7f47ac159530 2023-08-31T00:27:39.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0038e0 con 0x7f47ac159530 2023-08-31T00:27:39.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.331+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac0c2250 con 0x7f47ac159530 2023-08-31T00:27:39.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.332+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac06c240 con 0x7f47ac159530 2023-08-31T00:27:39.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.333+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f479c003a40 con 0x7f47ac159530 2023-08-31T00:27:39.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.334+0000 7f47a27fc700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f479006a0e0 0x7f479006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.334+0000 7f47b1c01700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f479006a0e0 0x7f479006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.334+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f479c087dd0 con 0x7f47ac159530 2023-08-31T00:27:39.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.334+0000 7f47b1c01700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f479006a0e0 0x7f479006c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000f60 tx=0x7f47a8009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:39.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.338+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f479c053750 con 0x7f47ac159530 2023-08-31T00:27:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.525+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47ac06c240 con 0x7f47ac159530 2023-08-31T00:27:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.526+0000 7f47a27fc700 1 -- 172.21.15.77:0/3001563963 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47ac06c240 con 0x7f47ac159530 2023-08-31T00:27:39.527 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:39.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f479006a0e0 msgr2=0x7f479006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f479006a0e0 0x7f479006c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47a8000f60 tx=0x7f47a8009040 comp rx=0 tx=0).stop 2023-08-31T00:27:39.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 msgr2=0x7f47ac14fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 0x7f47ac14fb30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c500 tx=0x7f479c00c8c0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 shutdown_connections 2023-08-31T00:27:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f479006a0e0 0x7f479006c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f47ac15dc10 0x7f47ac150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47ac0c9ee0 0x7f47ac0c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 --2- 172.21.15.77:0/3001563963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47ac159530 0x7f47ac14fb30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 >> 172.21.15.77:0/3001563963 conn(0x7f47ac0cf180 msgr2=0x7f47ac151250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:39.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 shutdown_connections 2023-08-31T00:27:39.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.528+0000 7f47b3e65700 1 -- 172.21.15.77:0/3001563963 wait complete. 2023-08-31T00:27:39.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:39.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 -- 172.21.15.77:0/1789763700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f723815b3d0 msgr2=0x7f72380cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 --2- 172.21.15.77:0/1789763700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f723815b3d0 0x7f72380cc320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f723815fff0 tx=0x7f722c009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 -- 172.21.15.77:0/1789763700 shutdown_connections 2023-08-31T00:27:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 --2- 172.21.15.77:0/1789763700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f723815b3d0 0x7f72380cc320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 --2- 172.21.15.77:0/1789763700 >> v2:172.21.15.139:3300/0 conn(0x7f72380b04a0 0x7f72380ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 -- 172.21.15.77:0/1789763700 >> 172.21.15.77:0/1789763700 conn(0x7f7238071630 msgr2=0x7f7238071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 -- 172.21.15.77:0/1789763700 shutdown_connections 2023-08-31T00:27:39.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.664+0000 7f723d2a8700 1 -- 172.21.15.77:0/1789763700 wait complete. 2023-08-31T00:27:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.665+0000 7f723d2a8700 1 Processor -- start 2023-08-31T00:27:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 -- start start 2023-08-31T00:27:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72380b04a0 0x7f7238156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 0x7f72380af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f723815b3d0 0x7f72380b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723815e8a0 con 0x7f72380ce7f0 2023-08-31T00:27:39.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723815dc90 con 0x7f723815b3d0 2023-08-31T00:27:39.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f723d2a8700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723815df70 con 0x7f72380b04a0 2023-08-31T00:27:39.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f72367fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 0x7f72380af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f72367fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 0x7f72380af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39870/0 (socket says 172.21.15.77:39870) 2023-08-31T00:27:39.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.666+0000 7f72367fc700 1 -- 172.21.15.77:0/839723855 learned_addr learned my addr 172.21.15.77:0/839723855 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:39.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f7236ffd700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72380b04a0 0x7f7238156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72377fe700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f723815b3d0 0x7f72380b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72367fc700 1 -- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72380b04a0 msgr2=0x7f7238156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72367fc700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72380b04a0 0x7f7238156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72367fc700 1 -- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f723815b3d0 msgr2=0x7f72380b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72367fc700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f723815b3d0 0x7f72380b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72367fc700 1 -- 172.21.15.77:0/839723855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c009520 con 0x7f72380ce7f0 2023-08-31T00:27:39.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f72367fc700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 0x7f72380af540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f722800c920 tx=0x7f722800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:39.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228007b00 con 0x7f72380ce7f0 2023-08-31T00:27:39.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7228007d50 con 0x7f72380ce7f0 2023-08-31T00:27:39.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228004a90 con 0x7f72380ce7f0 2023-08-31T00:27:39.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723815e250 con 0x7f72380ce7f0 2023-08-31T00:27:39.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.667+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72380b6410 con 0x7f72380ce7f0 2023-08-31T00:27:39.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.668+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7238073c30 con 0x7f72380ce7f0 2023-08-31T00:27:39.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.668+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7228004bf0 con 0x7f72380ce7f0 2023-08-31T00:27:39.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.669+0000 7f721f7fe700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f722406a0e0 0x7f722406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:39.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.669+0000 7f7236ffd700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f722406a0e0 0x7f722406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:39.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.669+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72280888a0 con 0x7f72380ce7f0 2023-08-31T00:27:39.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.669+0000 7f7236ffd700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f722406a0e0 0x7f722406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f722c009fd0 tx=0x7f722c019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:39.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.673+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7228053fe0 con 0x7f72380ce7f0 2023-08-31T00:27:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.879+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f72380b3fa0 con 0x7f72380ce7f0 2023-08-31T00:27:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.880+0000 7f721f7fe700 1 -- 172.21.15.77:0/839723855 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7228057600 con 0x7f72380ce7f0 2023-08-31T00:27:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f722406a0e0 msgr2=0x7f722406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f722406a0e0 0x7f722406c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f722c009fd0 tx=0x7f722c019040 comp rx=0 tx=0).stop 2023-08-31T00:27:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 msgr2=0x7f72380af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 0x7f72380af540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f722800c920 tx=0x7f722800cce0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 shutdown_connections 2023-08-31T00:27:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f722406a0e0 0x7f722406c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f72380b04a0 0x7f7238156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f723815b3d0 0x7f72380b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 --2- 172.21.15.77:0/839723855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72380ce7f0 0x7f72380af540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:39.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 >> 172.21.15.77:0/839723855 conn(0x7f7238071630 msgr2=0x7f723815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 shutdown_connections 2023-08-31T00:27:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:39.882+0000 7f723d2a8700 1 -- 172.21.15.77:0/839723855 wait complete. 2023-08-31T00:27:39.885 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:39.894 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2023-08-31T00:27:39.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:39.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-31T00:27:39.947 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:39.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:27:39.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:39.949 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-31T00:27:39.991 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:27:39.992 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:40.010 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:27:40.010 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:40.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:40.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 -- 172.21.15.77:0/3449216909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d01580f0 msgr2=0x7f82d00cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3449216909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d01580f0 0x7f82d00cc250 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f82c40098c0 tx=0x7f82c4009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 -- 172.21.15.77:0/3449216909 shutdown_connections 2023-08-31T00:27:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3449216909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d01580f0 0x7f82d00cc250 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 -- 172.21.15.77:0/3449216909 >> 172.21.15.77:0/3449216909 conn(0x7f82d006cbf0 msgr2=0x7f82d006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:40.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 -- 172.21.15.77:0/3449216909 shutdown_connections 2023-08-31T00:27:40.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.229+0000 7f82d69dc700 1 -- 172.21.15.77:0/3449216909 wait complete. 2023-08-31T00:27:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.231+0000 7f82d69dc700 1 Processor -- start 2023-08-31T00:27:40.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.231+0000 7f82d69dc700 1 -- start start 2023-08-31T00:27:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 0x7f82d01511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f82d00711d0 0x7f82d01e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82d01580f0 0x7f82d01e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d01f4040 con 0x7f82d006f130 2023-08-31T00:27:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c5270 con 0x7f82d01580f0 2023-08-31T00:27:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c5550 con 0x7f82d00711d0 2023-08-31T00:27:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 0x7f82d01511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 0x7f82d01511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39884/0 (socket says 172.21.15.77:39884) 2023-08-31T00:27:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 -- 172.21.15.77:0/3245753545 learned_addr learned my addr 172.21.15.77:0/3245753545 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:40.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d4f79700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82d01580f0 0x7f82d01e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 -- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f82d00711d0 msgr2=0x7f82d01e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cf7fe700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f82d00711d0 0x7f82d01e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f82d00711d0 0x7f82d01e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 -- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82d01580f0 msgr2=0x7f82d01e3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82d01580f0 0x7f82d01e3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 -- 172.21.15.77:0/3245753545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4009520 con 0x7f82d006f130 2023-08-31T00:27:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d4f79700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82d01580f0 0x7f82d01e3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cf7fe700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f82d00711d0 0x7f82d01e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82cffff700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 0x7f82d01511a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82d006c500 tx=0x7f82c4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:40.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400bbe0 con 0x7f82d006f130 2023-08-31T00:27:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f82c400be50 con 0x7f82d006f130 2023-08-31T00:27:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400f6c0 con 0x7f82d006f130 2023-08-31T00:27:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d00c5830 con 0x7f82d006f130 2023-08-31T00:27:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.232+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d01516e0 con 0x7f82d006f130 2023-08-31T00:27:40.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.233+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d00c5d50 con 0x7f82d006f130 2023-08-31T00:27:40.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.234+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f82c400f820 con 0x7f82d006f130 2023-08-31T00:27:40.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.234+0000 7f82ccff9700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f82bc06a0e0 0x7f82bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.234+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82c408a670 con 0x7f82d006f130 2023-08-31T00:27:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.234+0000 7f82cf7fe700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f82bc06a0e0 0x7f82bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.235+0000 7f82cf7fe700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f82bc06a0e0 0x7f82bc06c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82d0159400 tx=0x7f82c0009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:40.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.238+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f82d00c5d50 con 0x7f82d006f130 2023-08-31T00:27:40.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.434+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82d0073c30 con 0x7f82d006f130 2023-08-31T00:27:40.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.435+0000 7f82ccff9700 1 -- 172.21.15.77:0/3245753545 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16493 (secure 0 0 0) 0x7f82c4055ee0 con 0x7f82d006f130 2023-08-31T00:27:40.436 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:40.436 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:01.297037+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:40.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f82bc06a0e0 msgr2=0x7f82bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f82bc06a0e0 0x7f82bc06c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82d0159400 tx=0x7f82c0009040 comp rx=0 tx=0).stop 2023-08-31T00:27:40.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 msgr2=0x7f82d01511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 0x7f82d01511a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82d006c500 tx=0x7f82c4003f70 comp rx=0 tx=0).stop 2023-08-31T00:27:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 shutdown_connections 2023-08-31T00:27:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f82bc06a0e0 0x7f82bc06c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82d01580f0 0x7f82d01e3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82d006f130 0x7f82d01511a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 --2- 172.21.15.77:0/3245753545 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f82d00711d0 0x7f82d01e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 >> 172.21.15.77:0/3245753545 conn(0x7f82d006cbf0 msgr2=0x7f82d00ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 shutdown_connections 2023-08-31T00:27:40.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.437+0000 7f82d69dc700 1 -- 172.21.15.77:0/3245753545 wait complete. 2023-08-31T00:27:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:40.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f10161fe700 1 -- 172.21.15.77:0/314042952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ffc004030 msgr2=0x7f0ffc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f10161fe700 1 --2- 172.21.15.77:0/314042952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ffc004030 0x7f0ffc004850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800c310 tx=0x7f0ffc005880 comp rx=0 tx=0).stop 2023-08-31T00:27:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f100ffff700 1 -- 172.21.15.77:0/314042952 reap_dead start 2023-08-31T00:27:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f10161fe700 1 -- 172.21.15.77:0/314042952 shutdown_connections 2023-08-31T00:27:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f10161fe700 1 -- 172.21.15.77:0/314042952 >> 172.21.15.77:0/314042952 conn(0x7f101006cbf0 msgr2=0x7f101006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f10161fe700 1 -- 172.21.15.77:0/314042952 shutdown_connections 2023-08-31T00:27:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.576+0000 7f10161fe700 1 -- 172.21.15.77:0/314042952 wait complete. 2023-08-31T00:27:40.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.577+0000 7f10161fe700 1 Processor -- start 2023-08-31T00:27:40.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.577+0000 7f10161fe700 1 -- start start 2023-08-31T00:27:40.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f10161fe700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0ffc004030 0x7f10100c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f10161fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 0x7f10101510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f10161fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10100adb40 0x7f10100adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f10161fe700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100ae500 con 0x7f10100c3700 2023-08-31T00:27:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f10161fe700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c5200 con 0x7f10100adb40 2023-08-31T00:27:40.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f10161fe700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10100b0df0 con 0x7f0ffc004030 2023-08-31T00:27:40.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 0x7f10101510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 0x7f10101510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39906/0 (socket says 172.21.15.77:39906) 2023-08-31T00:27:40.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 -- 172.21.15.77:0/324297407 learned_addr learned my addr 172.21.15.77:0/324297407 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:40.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f100f7fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0ffc004030 0x7f10100c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f100ffff700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10100adb40 0x7f10100adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 -- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0ffc004030 msgr2=0x7f10100c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0ffc004030 0x7f10100c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 -- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10100adb40 msgr2=0x7f10100adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10100adb40 0x7f10100adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 -- 172.21.15.77:0/324297407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10101515e0 con 0x7f10100c3700 2023-08-31T00:27:40.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.578+0000 7f1006ffd700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 0x7f10101510a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0047a0 tx=0x7f0ff800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:40.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.579+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8006650 con 0x7f10100c3700 2023-08-31T00:27:40.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.579+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ff8003680 con 0x7f10100c3700 2023-08-31T00:27:40.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.579+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10100c2a60 con 0x7f10100c3700 2023-08-31T00:27:40.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.579+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8003ad0 con 0x7f10100c3700 2023-08-31T00:27:40.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.579+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10100c24a0 con 0x7f10100c3700 2023-08-31T00:27:40.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.580+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1010073c30 con 0x7f10100c3700 2023-08-31T00:27:40.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.581+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ff8022070 con 0x7f10100c3700 2023-08-31T00:27:40.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.581+0000 7f100cff9700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0ff006a0e0 0x7f0ff006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.581+0000 7f100f7fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0ff006a0e0 0x7f0ff006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.582+0000 7f100f7fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0ff006a0e0 0x7f0ff006c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f101006e9f0 tx=0x7f100000b2e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:40.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.582+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ff805a590 con 0x7f10100c3700 2023-08-31T00:27:40.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.586+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ff80561d0 con 0x7f10100c3700 2023-08-31T00:27:40.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.778+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10100b0f30 con 0x7f10100c3700 2023-08-31T00:27:40.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.778+0000 7f100cff9700 1 -- 172.21.15.77:0/324297407 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ff80597f0 con 0x7f10100c3700 2023-08-31T00:27:40.779 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0ff006a0e0 msgr2=0x7f0ff006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0ff006a0e0 0x7f0ff006c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f101006e9f0 tx=0x7f100000b2e0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 msgr2=0x7f10101510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 0x7f10101510a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0047a0 tx=0x7f0ff800cd30 comp rx=0 tx=0).stop 2023-08-31T00:27:40.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 shutdown_connections 2023-08-31T00:27:40.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0ff006a0e0 0x7f0ff006c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0ffc004030 0x7f10100c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10100adb40 0x7f10100adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 --2- 172.21.15.77:0/324297407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10100c3700 0x7f10101510a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 >> 172.21.15.77:0/324297407 conn(0x7f101006cbf0 msgr2=0x7f1010153550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:40.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 shutdown_connections 2023-08-31T00:27:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.780+0000 7f10161fe700 1 -- 172.21.15.77:0/324297407 wait complete. 2023-08-31T00:27:40.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a4217e700 1 -- 172.21.15.77:0/608963322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 msgr2=0x7f6a24004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a4217e700 1 --2- 172.21.15.77:0/608963322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a24004cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c2e0 tx=0x7f6a24005880 comp rx=0 tx=0).stop 2023-08-31T00:27:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a3bfff700 1 -- 172.21.15.77:0/608963322 reap_dead start 2023-08-31T00:27:40.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a4217e700 1 -- 172.21.15.77:0/608963322 shutdown_connections 2023-08-31T00:27:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a4217e700 1 -- 172.21.15.77:0/608963322 >> 172.21.15.77:0/608963322 conn(0x7f6a3c06cbf0 msgr2=0x7f6a3c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a4217e700 1 -- 172.21.15.77:0/608963322 shutdown_connections 2023-08-31T00:27:40.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.918+0000 7f6a4217e700 1 -- 172.21.15.77:0/608963322 wait complete. 2023-08-31T00:27:40.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.919+0000 7f6a4217e700 1 Processor -- start 2023-08-31T00:27:40.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.919+0000 7f6a4217e700 1 -- start start 2023-08-31T00:27:40.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a3c0c50f0 0x7f6a3c0c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a3c1eec60 0x7f6a3c1ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c64d0 con 0x7f6a24004850 2023-08-31T00:27:40.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c1ef620 con 0x7f6a3c0c50f0 2023-08-31T00:27:40.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c153850 con 0x7f6a3c1eec60 2023-08-31T00:27:40.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a3c069d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39924/0 (socket says 172.21.15.77:39924) 2023-08-31T00:27:40.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 -- 172.21.15.77:0/2843955264 learned_addr learned my addr 172.21.15.77:0/2843955264 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:40.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3affd700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a3c0c50f0 0x7f6a3c0c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3bfff700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a3c1eec60 0x7f6a3c1ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 -- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a3c1eec60 msgr2=0x7f6a3c1ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a3c1eec60 0x7f6a3c1ef0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 -- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a3c0c50f0 msgr2=0x7f6a3c0c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:40.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a3c0c50f0 0x7f6a3c0c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:40.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 -- 172.21.15.77:0/2843955264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0c5c60 con 0x7f6a24004850 2023-08-31T00:27:40.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a3b7fe700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a3c069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6a300109d0 tx=0x7f6a30010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:40.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000ec50 con 0x7f6a24004850 2023-08-31T00:27:40.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6a30015070 con 0x7f6a24004850 2023-08-31T00:27:40.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c0c5f40 con 0x7f6a24004850 2023-08-31T00:27:40.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300116a0 con 0x7f6a24004850 2023-08-31T00:27:40.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.920+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c0c6a00 con 0x7f6a24004850 2023-08-31T00:27:40.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.921+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c0c6bc0 con 0x7f6a24004850 2023-08-31T00:27:40.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.922+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a30011800 con 0x7f6a24004850 2023-08-31T00:27:40.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.922+0000 7f6a23fff700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a2806a0e0 0x7f6a2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:40.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.922+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6a30088cd0 con 0x7f6a24004850 2023-08-31T00:27:40.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.922+0000 7f6a3affd700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a2806a0e0 0x7f6a2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:40.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.923+0000 7f6a3affd700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a2806a0e0 0x7f6a2806c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c001930 tx=0x7f6a2c00f000 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:40.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:40.926+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a30054430 con 0x7f6a24004850 2023-08-31T00:27:41.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.114+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a3c0c6d70 con 0x7f6a24004850 2023-08-31T00:27:41.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.114+0000 7f6a23fff700 1 -- 172.21.15.77:0/2843955264 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a30057a50 con 0x7f6a24004850 2023-08-31T00:27:41.116 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:41.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.116+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a2806a0e0 msgr2=0x7f6a2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.116+0000 7f6a4217e700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a2806a0e0 0x7f6a2806c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c001930 tx=0x7f6a2c00f000 comp rx=0 tx=0).stop 2023-08-31T00:27:41.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.116+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 msgr2=0x7f6a3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.116+0000 7f6a4217e700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a3c069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6a300109d0 tx=0x7f6a30010d90 comp rx=0 tx=0).stop 2023-08-31T00:27:41.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 shutdown_connections 2023-08-31T00:27:41.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f6a2806a0e0 0x7f6a2806c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6a3c1eec60 0x7f6a3c1ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a24004850 0x7f6a3c069d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 --2- 172.21.15.77:0/2843955264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a3c0c50f0 0x7f6a3c0c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 >> 172.21.15.77:0/2843955264 conn(0x7f6a3c06cbf0 msgr2=0x7f6a3c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:41.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 shutdown_connections 2023-08-31T00:27:41.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.117+0000 7f6a4217e700 1 -- 172.21.15.77:0/2843955264 wait complete. 2023-08-31T00:27:41.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:41.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf88886700 1 -- 172.21.15.77:0/3445734175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 msgr2=0x7faf6c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf88886700 1 --2- 172.21.15.77:0/3445734175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf6c005210 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faf7c001f20 tx=0x7faf6c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf82d9d700 1 -- 172.21.15.77:0/3445734175 reap_dead start 2023-08-31T00:27:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf88886700 1 -- 172.21.15.77:0/3445734175 shutdown_connections 2023-08-31T00:27:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf88886700 1 -- 172.21.15.77:0/3445734175 >> 172.21.15.77:0/3445734175 conn(0x7faf840afbf0 msgr2=0x7faf840b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf88886700 1 -- 172.21.15.77:0/3445734175 shutdown_connections 2023-08-31T00:27:41.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.255+0000 7faf88886700 1 -- 172.21.15.77:0/3445734175 wait complete. 2023-08-31T00:27:41.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 Processor -- start 2023-08-31T00:27:41.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 -- start start 2023-08-31T00:27:41.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf8414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf841e2920 0x7faf841e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840aefd0 0x7faf840af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840af9c0 con 0x7faf6c004d90 2023-08-31T00:27:41.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c2f00 con 0x7faf840aefd0 2023-08-31T00:27:41.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf88886700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf84069e80 con 0x7faf841e2920 2023-08-31T00:27:41.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf8259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf8414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf8259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf8414e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39944/0 (socket says 172.21.15.77:39944) 2023-08-31T00:27:41.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.257+0000 7faf8259c700 1 -- 172.21.15.77:0/793640834 learned_addr learned my addr 172.21.15.77:0/793640834 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf82d9d700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840aefd0 0x7faf840af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf81d9b700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf841e2920 0x7faf841e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf8259c700 1 -- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf841e2920 msgr2=0x7faf841e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf8259c700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf841e2920 0x7faf841e2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf8259c700 1 -- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840aefd0 msgr2=0x7faf840af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf8259c700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840aefd0 0x7faf840af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf8259c700 1 -- 172.21.15.77:0/793640834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8406a160 con 0x7faf6c004d90 2023-08-31T00:27:41.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf8259c700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf8414e650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faf78010a70 tx=0x7faf78010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:41.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800ec50 con 0x7faf6c004d90 2023-08-31T00:27:41.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf78015070 con 0x7faf6c004d90 2023-08-31T00:27:41.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7801c6e0 con 0x7faf6c004d90 2023-08-31T00:27:41.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8406a440 con 0x7faf6c004d90 2023-08-31T00:27:41.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.258+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf84069b10 con 0x7faf6c004d90 2023-08-31T00:27:41.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.259+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8406a960 con 0x7faf6c004d90 2023-08-31T00:27:41.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.259+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf7801c840 con 0x7faf6c004d90 2023-08-31T00:27:41.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.260+0000 7faf72ffd700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf6406a0e0 0x7faf6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.260+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faf78017070 con 0x7faf6c004d90 2023-08-31T00:27:41.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.260+0000 7faf81d9b700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf6406a0e0 0x7faf6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.260+0000 7faf81d9b700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf6406a0e0 0x7faf6406c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf74001050 tx=0x7faf74001e50 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:41.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.264+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf78054760 con 0x7faf6c004d90 2023-08-31T00:27:41.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.453+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf84073c30 con 0x7faf6c004d90 2023-08-31T00:27:41.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.454+0000 7faf72ffd700 1 -- 172.21.15.77:0/793640834 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf7800eea0 con 0x7faf6c004d90 2023-08-31T00:27:41.455 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:41.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf6406a0e0 msgr2=0x7faf6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf6406a0e0 0x7faf6406c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf74001050 tx=0x7faf74001e50 comp rx=0 tx=0).stop 2023-08-31T00:27:41.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 msgr2=0x7faf8414e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf8414e650 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faf78010a70 tx=0x7faf78010e30 comp rx=0 tx=0).stop 2023-08-31T00:27:41.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 shutdown_connections 2023-08-31T00:27:41.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7faf6406a0e0 0x7faf6406c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf840aefd0 0x7faf840af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf6c004d90 0x7faf8414e650 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 --2- 172.21.15.77:0/793640834 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faf841e2920 0x7faf841e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 >> 172.21.15.77:0/793640834 conn(0x7faf840afbf0 msgr2=0x7faf840ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:41.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 shutdown_connections 2023-08-31T00:27:41.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.456+0000 7faf88886700 1 -- 172.21.15.77:0/793640834 wait complete. 2023-08-31T00:27:41.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:41.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 -- 172.21.15.77:0/1039055107 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 msgr2=0x7fdbb4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/1039055107 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 0x7fdbb4003e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8005fd0 tx=0x7fdbb4005880 comp rx=0 tx=0).stop 2023-08-31T00:27:41.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 -- 172.21.15.77:0/1039055107 shutdown_connections 2023-08-31T00:27:41.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/1039055107 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 0x7fdbb4003e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 -- 172.21.15.77:0/1039055107 >> 172.21.15.77:0/1039055107 conn(0x7fdbc80cd370 msgr2=0x7fdbc80cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:41.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 -- 172.21.15.77:0/1039055107 shutdown_connections 2023-08-31T00:27:41.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.598+0000 7fdbce4d9700 1 -- 172.21.15.77:0/1039055107 wait complete. 2023-08-31T00:27:41.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.599+0000 7fdbce4d9700 1 Processor -- start 2023-08-31T00:27:41.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.599+0000 7fdbce4d9700 1 -- start start 2023-08-31T00:27:41.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbce4d9700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 0x7fdbc80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbce4d9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbc80c5b40 0x7fdbc8096780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbce4d9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 0x7fdbc8157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbce4d9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81577d0 con 0x7fdbc8156e00 2023-08-31T00:27:41.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbce4d9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc8158c50 con 0x7fdbc80c5b40 2023-08-31T00:27:41.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbce4d9700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc8158040 con 0x7fdbb4003a00 2023-08-31T00:27:41.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 0x7fdbc8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 0x7fdbc8157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39968/0 (socket says 172.21.15.77:39968) 2023-08-31T00:27:41.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 -- 172.21.15.77:0/2416140541 learned_addr learned my addr 172.21.15.77:0/2416140541 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:41.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbc7fff700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 0x7fdbc80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbbffff700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbc80c5b40 0x7fdbc8096780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 -- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 msgr2=0x7fdbc80c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 0x7fdbc80c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 -- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbc80c5b40 msgr2=0x7fdbc8096780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbc80c5b40 0x7fdbc8096780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 -- 172.21.15.77:0/2416140541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8158320 con 0x7fdbc8156e00 2023-08-31T00:27:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbcca76700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 0x7fdbc8157290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8070b70 tx=0x7fdbc0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.600+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0006530 con 0x7fdbc8156e00 2023-08-31T00:27:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.601+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbc00066b0 con 0x7fdbc8156e00 2023-08-31T00:27:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.601+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc8158600 con 0x7fdbc8156e00 2023-08-31T00:27:41.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.601+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc001a440 con 0x7fdbc8156e00 2023-08-31T00:27:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.601+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc8157c80 con 0x7fdbc8156e00 2023-08-31T00:27:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.602+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc8073c30 con 0x7fdbc8156e00 2023-08-31T00:27:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.602+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdbc00233f0 con 0x7fdbc8156e00 2023-08-31T00:27:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.602+0000 7fdbc57fa700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdba806a0e0 0x7fdba806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:41.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.602+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdbc008a970 con 0x7fdbc8156e00 2023-08-31T00:27:41.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.602+0000 7fdbc7fff700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdba806a0e0 0x7fdba806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:41.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.603+0000 7fdbc7fff700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdba806a0e0 0x7fdba806c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800bae0 tx=0x7fdbb801d040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:41.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.607+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdbc0056040 con 0x7fdbc8156e00 2023-08-31T00:27:41.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.812+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdbc8157ae0 con 0x7fdbc8156e00 2023-08-31T00:27:41.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.812+0000 7fdbc57fa700 1 -- 172.21.15.77:0/2416140541 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdbc8157ae0 con 0x7fdbc8156e00 2023-08-31T00:27:41.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdba806a0e0 msgr2=0x7fdba806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdba806a0e0 0x7fdba806c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800bae0 tx=0x7fdbb801d040 comp rx=0 tx=0).stop 2023-08-31T00:27:41.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 msgr2=0x7fdbc8157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:41.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 0x7fdbc8157290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8070b70 tx=0x7fdbc0011ae0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 shutdown_connections 2023-08-31T00:27:41.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdba806a0e0 0x7fdba806c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdbb4003a00 0x7fdbc80c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdbc8156e00 0x7fdbc8157290 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 --2- 172.21.15.77:0/2416140541 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbc80c5b40 0x7fdbc8096780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:41.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 >> 172.21.15.77:0/2416140541 conn(0x7fdbc80cd370 msgr2=0x7fdbc80cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:41.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 shutdown_connections 2023-08-31T00:27:41.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:41.814+0000 7fdbce4d9700 1 -- 172.21.15.77:0/2416140541 wait complete. 2023-08-31T00:27:41.818 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:41.827 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:27:41.827 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:41.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 -- 172.21.15.77:0/2100541340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4c004850 msgr2=0x7f7b4c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2100541340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4c004850 0x7f7b4c004cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400c310 tx=0x7f7b4c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 -- 172.21.15.77:0/2100541340 shutdown_connections 2023-08-31T00:27:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2100541340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4c004850 0x7f7b4c004cd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 -- 172.21.15.77:0/2100541340 >> 172.21.15.77:0/2100541340 conn(0x7f7b6406cbf0 msgr2=0x7f7b6406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:42.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 -- 172.21.15.77:0/2100541340 shutdown_connections 2023-08-31T00:27:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.007+0000 7f7b690f5700 1 -- 172.21.15.77:0/2100541340 wait complete. 2023-08-31T00:27:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 Processor -- start 2023-08-31T00:27:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 -- start start 2023-08-31T00:27:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b4c004850 0x7f7b640c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 0x7f7b640c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7b6415a940 0x7f7b6415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641f59c0 con 0x7f7b640c50f0 2023-08-31T00:27:42.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640c4910 con 0x7f7b4c004850 2023-08-31T00:27:42.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b690f5700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6415b310 con 0x7f7b6415a940 2023-08-31T00:27:42.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b6259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 0x7f7b640c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b6259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 0x7f7b640c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39984/0 (socket says 172.21.15.77:39984) 2023-08-31T00:27:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.009+0000 7f7b6259c700 1 -- 172.21.15.77:0/2364295100 learned_addr learned my addr 172.21.15.77:0/2364295100 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6359e700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7b6415a940 0x7f7b6415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b62d9d700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b4c004850 0x7f7b640c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6259c700 1 -- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7b6415a940 msgr2=0x7f7b6415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6259c700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7b6415a940 0x7f7b6415add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6259c700 1 -- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b4c004850 msgr2=0x7f7b640c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6259c700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b4c004850 0x7f7b640c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6259c700 1 -- 172.21.15.77:0/2364295100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b641f5de0 con 0x7f7b640c50f0 2023-08-31T00:27:42.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b6259c700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 0x7f7b640c7a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c130 tx=0x7f7b5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54006650 con 0x7f7b640c50f0 2023-08-31T00:27:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7b54003680 con 0x7f7b640c50f0 2023-08-31T00:27:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641f5040 con 0x7f7b640c50f0 2023-08-31T00:27:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54003a70 con 0x7f7b640c50f0 2023-08-31T00:27:42.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.010+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b641f55e0 con 0x7f7b640c50f0 2023-08-31T00:27:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.011+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b64073c30 con 0x7f7b640c50f0 2023-08-31T00:27:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.011+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b54021070 con 0x7f7b640c50f0 2023-08-31T00:27:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.012+0000 7f7b4b7fe700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7b5006a0e0 0x7f7b5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.012+0000 7f7b62d9d700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7b5006a0e0 0x7f7b5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.012+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7b5408a1e0 con 0x7f7b640c50f0 2023-08-31T00:27:42.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.012+0000 7f7b62d9d700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7b5006a0e0 0x7f7b5006c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b58000c00 tx=0x7f7b58000fe0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:42.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.016+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b540559d0 con 0x7f7b640c50f0 2023-08-31T00:27:42.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.208+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b64152dc0 con 0x7f7b640c50f0 2023-08-31T00:27:42.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.209+0000 7f7b4b7fe700 1 -- 172.21.15.77:0/2364295100 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16743 (secure 0 0 0) 0x7f7b54003bd0 con 0x7f7b640c50f0 2023-08-31T00:27:42.210 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:41.588266+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:42.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7b5006a0e0 msgr2=0x7f7b5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7b5006a0e0 0x7f7b5006c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7b58000c00 tx=0x7f7b58000fe0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 msgr2=0x7f7b640c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 0x7f7b640c7a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00c130 tx=0x7f7b5400ccb0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 shutdown_connections 2023-08-31T00:27:42.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7b5006a0e0 0x7f7b5006c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7b6415a940 0x7f7b6415add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b4c004850 0x7f7b640c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 --2- 172.21.15.77:0/2364295100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b640c50f0 0x7f7b640c7a40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 >> 172.21.15.77:0/2364295100 conn(0x7f7b6406cbf0 msgr2=0x7f7b640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:42.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 shutdown_connections 2023-08-31T00:27:42.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.211+0000 7f7b690f5700 1 -- 172.21.15.77:0/2364295100 wait complete. 2023-08-31T00:27:42.224 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:42.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:42.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 -- 172.21.15.77:0/1414540497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac006f130 msgr2=0x7fdac0070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 --2- 172.21.15.77:0/1414540497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac006f130 0x7fdac0070ac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdac00cb890 tx=0x7fdab0009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 -- 172.21.15.77:0/1414540497 shutdown_connections 2023-08-31T00:27:42.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 --2- 172.21.15.77:0/1414540497 >> v2:172.21.15.139:3300/0 conn(0x7fdac0071000 0x7fdac015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 --2- 172.21.15.77:0/1414540497 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdac01580f0 0x7fdac00cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 --2- 172.21.15.77:0/1414540497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac006f130 0x7fdac0070ac0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 -- 172.21.15.77:0/1414540497 >> 172.21.15.77:0/1414540497 conn(0x7fdac006cbf0 msgr2=0x7fdac006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:42.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 -- 172.21.15.77:0/1414540497 shutdown_connections 2023-08-31T00:27:42.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.350+0000 7fdac5f93700 1 -- 172.21.15.77:0/1414540497 wait complete. 2023-08-31T00:27:42.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 Processor -- start 2023-08-31T00:27:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 -- start start 2023-08-31T00:27:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdac006f130 0x7fdac00c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 0x7fdac00c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdac01580f0 0x7fdac0154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00c7ae0 con 0x7fdac0071000 2023-08-31T00:27:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00c6500 con 0x7fdac006f130 2023-08-31T00:27:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.352+0000 7fdac5f93700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00c67e0 con 0x7fdac01580f0 2023-08-31T00:27:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 0x7fdac00c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 0x7fdac00c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39998/0 (socket says 172.21.15.77:39998) 2023-08-31T00:27:42.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 -- 172.21.15.77:0/3660107086 learned_addr learned my addr 172.21.15.77:0/3660107086 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabffff700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdac01580f0 0x7fdac0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 -- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdac01580f0 msgr2=0x7fdac0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdac01580f0 0x7fdac0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabf7fe700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdac006f130 0x7fdac00c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 -- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdac006f130 msgr2=0x7fdac00c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdac006f130 0x7fdac00c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 -- 172.21.15.77:0/3660107086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00095f0 con 0x7fdac0071000 2023-08-31T00:27:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabf7fe700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdac006f130 0x7fdac00c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:42.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdabeffd700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 0x7fdac00c2b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdac006c500 tx=0x7fdab00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab001d070 con 0x7fdac0071000 2023-08-31T00:27:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdab0003890 con 0x7fdac0071000 2023-08-31T00:27:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac00c6ac0 con 0x7fdac0071000 2023-08-31T00:27:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab00045f0 con 0x7fdac0071000 2023-08-31T00:27:42.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.353+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac00c7080 con 0x7fdac0071000 2023-08-31T00:27:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.354+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0073c30 con 0x7fdac0071000 2023-08-31T00:27:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.355+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdab0003ca0 con 0x7fdac0071000 2023-08-31T00:27:42.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.355+0000 7fdaa7fff700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdaac06a0e0 0x7fdaac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.355+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdab0089d00 con 0x7fdac0071000 2023-08-31T00:27:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.355+0000 7fdabf7fe700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdaac06a0e0 0x7fdaac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.356+0000 7fdabf7fe700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdaac06a0e0 0x7fdaac06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005fd0 tx=0x7fdab4005dc0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:42.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.360+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdab0055610 con 0x7fdac0071000 2023-08-31T00:27:42.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.550+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdac01585b0 con 0x7fdac0071000 2023-08-31T00:27:42.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.550+0000 7fdaa7fff700 1 -- 172.21.15.77:0/3660107086 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdab0027020 con 0x7fdac0071000 2023-08-31T00:27:42.551 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:42.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdaac06a0e0 msgr2=0x7fdaac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdaac06a0e0 0x7fdaac06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005fd0 tx=0x7fdab4005dc0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 msgr2=0x7fdac00c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 0x7fdac00c2b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdac006c500 tx=0x7fdab00042f0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 shutdown_connections 2023-08-31T00:27:42.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fdaac06a0e0 0x7fdaac06c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdac01580f0 0x7fdac0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdac006f130 0x7fdac00c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 --2- 172.21.15.77:0/3660107086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdac0071000 0x7fdac00c2b00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 >> 172.21.15.77:0/3660107086 conn(0x7fdac006cbf0 msgr2=0x7fdac015a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:42.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 shutdown_connections 2023-08-31T00:27:42.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.552+0000 7fdac5f93700 1 -- 172.21.15.77:0/3660107086 wait complete. 2023-08-31T00:27:42.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:42.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 -- 172.21.15.77:0/837176969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1100caca0 msgr2=0x7fd1101598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 --2- 172.21.15.77:0/837176969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1100caca0 0x7fd1101598f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd1000098c0 tx=0x7fd100009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 -- 172.21.15.77:0/837176969 shutdown_connections 2023-08-31T00:27:42.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 --2- 172.21.15.77:0/837176969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1100caca0 0x7fd1101598f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 --2- 172.21.15.77:0/837176969 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1100cb080 0x7fd1100cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 -- 172.21.15.77:0/837176969 >> 172.21.15.77:0/837176969 conn(0x7fd11006cbf0 msgr2=0x7fd11006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:42.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 -- 172.21.15.77:0/837176969 shutdown_connections 2023-08-31T00:27:42.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.690+0000 7fd1175b7700 1 -- 172.21.15.77:0/837176969 wait complete. 2023-08-31T00:27:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.691+0000 7fd1175b7700 1 Processor -- start 2023-08-31T00:27:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.691+0000 7fd1175b7700 1 -- start start 2023-08-31T00:27:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd1175b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 0x7fd1100b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd1175b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1100caca0 0x7fd1101eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd1175b7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1100cb080 0x7fd110150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd1175b7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1101513f0 con 0x7fd110069b10 2023-08-31T00:27:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd1175b7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1101516a0 con 0x7fd1100caca0 2023-08-31T00:27:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd1175b7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100c2c00 con 0x7fd1100cb080 2023-08-31T00:27:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd115353700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 0x7fd1100b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd115353700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 0x7fd1100b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40010/0 (socket says 172.21.15.77:40010) 2023-08-31T00:27:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd115353700 1 -- 172.21.15.77:0/3425361941 learned_addr learned my addr 172.21.15.77:0/3425361941 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd115353700 1 -- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1100cb080 msgr2=0x7fd110150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.692+0000 7fd115353700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1100cb080 0x7fd110150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd115353700 1 -- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1100caca0 msgr2=0x7fd1101eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd114b52700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1100caca0 0x7fd1101eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd115353700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1100caca0 0x7fd1101eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd115353700 1 -- 172.21.15.77:0/3425361941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100009520 con 0x7fd110069b10 2023-08-31T00:27:42.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd115353700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 0x7fd1100b1a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1100cdea0 tx=0x7fd100017750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:42.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10001c070 con 0x7fd110069b10 2023-08-31T00:27:42.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd100017d40 con 0x7fd110069b10 2023-08-31T00:27:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1100c2ee0 con 0x7fd110069b10 2023-08-31T00:27:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000042b0 con 0x7fd110069b10 2023-08-31T00:27:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.693+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd110151980 con 0x7fd110069b10 2023-08-31T00:27:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.694+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1100c3400 con 0x7fd110069b10 2023-08-31T00:27:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.694+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd100004410 con 0x7fd110069b10 2023-08-31T00:27:42.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.695+0000 7fd105ffb700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd0f406a0e0 0x7fd0f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.695+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd100089b60 con 0x7fd110069b10 2023-08-31T00:27:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.695+0000 7fd114b52700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd0f406a0e0 0x7fd0f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.695+0000 7fd114b52700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd0f406a0e0 0x7fd0f406c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1101492f0 tx=0x7fd10c005cb0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.699+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd1100c3400 con 0x7fd110069b10 2023-08-31T00:27:42.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.886+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1100c3400 con 0x7fd110069b10 2023-08-31T00:27:42.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.886+0000 7fd105ffb700 1 -- 172.21.15.77:0/3425361941 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1100c3400 con 0x7fd110069b10 2023-08-31T00:27:42.887 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:42.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd0f406a0e0 msgr2=0x7fd0f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd0f406a0e0 0x7fd0f406c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd1101492f0 tx=0x7fd10c005cb0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 msgr2=0x7fd1100b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 0x7fd1100b1a10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1100cdea0 tx=0x7fd100017750 comp rx=0 tx=0).stop 2023-08-31T00:27:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 shutdown_connections 2023-08-31T00:27:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd0f406a0e0 0x7fd0f406c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd1100cb080 0x7fd110150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd110069b10 0x7fd1100b1a10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 --2- 172.21.15.77:0/3425361941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1100caca0 0x7fd1101eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:42.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 >> 172.21.15.77:0/3425361941 conn(0x7fd11006cbf0 msgr2=0x7fd11006e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:42.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 shutdown_connections 2023-08-31T00:27:42.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:42.888+0000 7fd1175b7700 1 -- 172.21.15.77:0/3425361941 wait complete. 2023-08-31T00:27:42.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:43.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 -- 172.21.15.77:0/1227214234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 msgr2=0x7f5d240cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 --2- 172.21.15.77:0/1227214234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d240cd680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5d2406d140 tx=0x7f5d1c00b380 comp rx=0 tx=0).stop 2023-08-31T00:27:43.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 -- 172.21.15.77:0/1227214234 shutdown_connections 2023-08-31T00:27:43.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 --2- 172.21.15.77:0/1227214234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d240cd680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 --2- 172.21.15.77:0/1227214234 >> v2:172.21.15.139:3300/0 conn(0x7f5d24155bc0 0x7f5d24159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 --2- 172.21.15.77:0/1227214234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d24155fa0 0x7f5d240702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 -- 172.21.15.77:0/1227214234 >> 172.21.15.77:0/1227214234 conn(0x7f5d24069d50 msgr2=0x7f5d2406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:43.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 -- 172.21.15.77:0/1227214234 shutdown_connections 2023-08-31T00:27:43.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.025+0000 7f5d28f86700 1 -- 172.21.15.77:0/1227214234 wait complete. 2023-08-31T00:27:43.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.026+0000 7f5d28f86700 1 Processor -- start 2023-08-31T00:27:43.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.026+0000 7f5d28f86700 1 -- start start 2023-08-31T00:27:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d28f86700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d241398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d28f86700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d24155bc0 0x7f5d240cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d28f86700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d24155fa0 0x7f5d241e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d28f86700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24156410 con 0x7f5d240cd1f0 2023-08-31T00:27:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d28f86700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24139de0 con 0x7f5d24155fa0 2023-08-31T00:27:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d28f86700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240aefa0 con 0x7f5d24155bc0 2023-08-31T00:27:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d2259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d241398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d2259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d241398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40024/0 (socket says 172.21.15.77:40024) 2023-08-31T00:27:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.027+0000 7f5d2259c700 1 -- 172.21.15.77:0/2373885110 learned_addr learned my addr 172.21.15.77:0/2373885110 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d2259c700 1 -- 172.21.15.77:0/2373885110 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d24155bc0 msgr2=0x7f5d240cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d2259c700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d24155bc0 0x7f5d240cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d2259c700 1 -- 172.21.15.77:0/2373885110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d24155fa0 msgr2=0x7f5d241e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d2259c700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d24155fa0 0x7f5d241e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d2259c700 1 -- 172.21.15.77:0/2373885110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009d00 con 0x7f5d240cd1f0 2023-08-31T00:27:43.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d2259c700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d241398a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c920 tx=0x7f5d1400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:43.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14007b00 con 0x7f5d240cd1f0 2023-08-31T00:27:43.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5d14007d50 con 0x7f5d240cd1f0 2023-08-31T00:27:43.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d240af280 con 0x7f5d240cd1f0 2023-08-31T00:27:43.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14004a90 con 0x7f5d240cd1f0 2023-08-31T00:27:43.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.028+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d240af840 con 0x7f5d240cd1f0 2023-08-31T00:27:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.029+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d24073c30 con 0x7f5d240cd1f0 2023-08-31T00:27:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.029+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5d14004bf0 con 0x7f5d240cd1f0 2023-08-31T00:27:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.030+0000 7f5d12ffd700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d0406a0e0 0x7f5d0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.030+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5d140888f0 con 0x7f5d240cd1f0 2023-08-31T00:27:43.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.030+0000 7f5d21d9b700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d0406a0e0 0x7f5d0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.030+0000 7f5d21d9b700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d0406a0e0 0x7f5d0406c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d241f2d10 tx=0x7f5d18005b50 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:43.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.034+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5d14054050 con 0x7f5d240cd1f0 2023-08-31T00:27:43.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.221+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d240c9540 con 0x7f5d240cd1f0 2023-08-31T00:27:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.221+0000 7f5d12ffd700 1 -- 172.21.15.77:0/2373885110 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d14057670 con 0x7f5d240cd1f0 2023-08-31T00:27:43.222 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:43.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d0406a0e0 msgr2=0x7f5d0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d0406a0e0 0x7f5d0406c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d241f2d10 tx=0x7f5d18005b50 comp rx=0 tx=0).stop 2023-08-31T00:27:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 msgr2=0x7f5d241398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d241398a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c920 tx=0x7f5d1400cce0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 shutdown_connections 2023-08-31T00:27:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5d0406a0e0 0x7f5d0406c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d24155fa0 0x7f5d241e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d240cd1f0 0x7f5d241398a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 --2- 172.21.15.77:0/2373885110 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5d24155bc0 0x7f5d240cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 >> 172.21.15.77:0/2373885110 conn(0x7f5d24069d50 msgr2=0x7f5d2414bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:43.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 shutdown_connections 2023-08-31T00:27:43.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.223+0000 7f5d28f86700 1 -- 172.21.15.77:0/2373885110 wait complete. 2023-08-31T00:27:43.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f2273f9e700 1 -- 172.21.15.77:0/453856741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2258004850 msgr2=0x7f2258004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f2273f9e700 1 --2- 172.21.15.77:0/453856741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2258004850 0x7f2258004cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2268005fd0 tx=0x7f2258005880 comp rx=0 tx=0).stop 2023-08-31T00:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f227253b700 1 -- 172.21.15.77:0/453856741 reap_dead start 2023-08-31T00:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f2273f9e700 1 -- 172.21.15.77:0/453856741 shutdown_connections 2023-08-31T00:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f2273f9e700 1 -- 172.21.15.77:0/453856741 >> 172.21.15.77:0/453856741 conn(0x7f226c06cbf0 msgr2=0x7f226c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f2273f9e700 1 -- 172.21.15.77:0/453856741 shutdown_connections 2023-08-31T00:27:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.360+0000 7f2273f9e700 1 -- 172.21.15.77:0/453856741 wait complete. 2023-08-31T00:27:43.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.361+0000 7f2273f9e700 1 Processor -- start 2023-08-31T00:27:43.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.361+0000 7f2273f9e700 1 -- start start 2023-08-31T00:27:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2273f9e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2258004850 0x7f226c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2273f9e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 0x7f226c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2273f9e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226c0c6dd0 0x7f226c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2273f9e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1557b0 con 0x7f226c155a00 2023-08-31T00:27:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2273f9e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c7790 con 0x7f226c0c6dd0 2023-08-31T00:27:43.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2273f9e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c7fa0 con 0x7f2258004850 2023-08-31T00:27:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 0x7f226c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 0x7f226c155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40046/0 (socket says 172.21.15.77:40046) 2023-08-31T00:27:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 -- 172.21.15.77:0/2605423480 learned_addr learned my addr 172.21.15.77:0/2605423480 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:43.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 -- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2258004850 msgr2=0x7f226c0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271d3a700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2258004850 0x7f226c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2258004850 0x7f226c0c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f227253b700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226c0c6dd0 0x7f226c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 -- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226c0c6dd0 msgr2=0x7f226c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226c0c6dd0 0x7f226c156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.362+0000 7f2271539700 1 -- 172.21.15.77:0/2605423480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0c5c30 con 0x7f226c155a00 2023-08-31T00:27:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.363+0000 7f2271539700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 0x7f226c155270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22580047a0 tx=0x7f2268004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:43.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.363+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268020070 con 0x7f226c155a00 2023-08-31T00:27:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.363+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f226800d9e0 con 0x7f226c155a00 2023-08-31T00:27:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.363+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c0c79e0 con 0x7f226c155a00 2023-08-31T00:27:43.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.363+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800ddb0 con 0x7f226c155a00 2023-08-31T00:27:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.363+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0c7250 con 0x7f226c155a00 2023-08-31T00:27:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.364+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c0c6650 con 0x7f226c155a00 2023-08-31T00:27:43.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.364+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2268003680 con 0x7f226c155a00 2023-08-31T00:27:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.365+0000 7f22627fc700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f225006a0e0 0x7f225006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.365+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f226808b4b0 con 0x7f226c155a00 2023-08-31T00:27:43.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.365+0000 7f2271d3a700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f225006a0e0 0x7f225006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.365+0000 7f2271d3a700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f225006a0e0 0x7f225006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f225c001eb0 tx=0x7f225c001e20 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:43.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.369+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2268056b80 con 0x7f226c155a00 2023-08-31T00:27:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.575+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f226c0c5f60 con 0x7f226c155a00 2023-08-31T00:27:43.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.575+0000 7f22627fc700 1 -- 172.21.15.77:0/2605423480 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f226805a1a0 con 0x7f226c155a00 2023-08-31T00:27:43.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f225006a0e0 msgr2=0x7f225006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f225006a0e0 0x7f225006c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f225c001eb0 tx=0x7f225c001e20 comp rx=0 tx=0).stop 2023-08-31T00:27:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 msgr2=0x7f226c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 0x7f226c155270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22580047a0 tx=0x7f2268004b10 comp rx=0 tx=0).stop 2023-08-31T00:27:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 shutdown_connections 2023-08-31T00:27:43.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f225006a0e0 0x7f225006c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2258004850 0x7f226c0c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f226c0c6dd0 0x7f226c156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 --2- 172.21.15.77:0/2605423480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f226c155a00 0x7f226c155270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 >> 172.21.15.77:0/2605423480 conn(0x7f226c06cbf0 msgr2=0x7f226c1590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:43.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 shutdown_connections 2023-08-31T00:27:43.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.577+0000 7f2273f9e700 1 -- 172.21.15.77:0/2605423480 wait complete. 2023-08-31T00:27:43.581 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:43.590 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-08-31T00:27:43.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:43.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-08-31T00:27:43.627 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:43.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-08-31T00:27:43.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:43.629 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-31T00:27:43.685 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:27:43.686 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:43.709 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:27:43.709 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:43.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:43.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 -- 172.21.15.77:0/2546888679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b81580f0 msgr2=0x7fa2b80cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/2546888679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b81580f0 0x7fa2b80cc250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac005fd0 tx=0x7fa2ac009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:43.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 -- 172.21.15.77:0/2546888679 shutdown_connections 2023-08-31T00:27:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/2546888679 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b80711d0 0x7fa2b80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/2546888679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b81580f0 0x7fa2b80cc250 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 -- 172.21.15.77:0/2546888679 >> 172.21.15.77:0/2546888679 conn(0x7fa2b806cbf0 msgr2=0x7fa2b806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 -- 172.21.15.77:0/2546888679 shutdown_connections 2023-08-31T00:27:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.893+0000 7fa2be5f9700 1 -- 172.21.15.77:0/2546888679 wait complete. 2023-08-31T00:27:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.894+0000 7fa2be5f9700 1 Processor -- start 2023-08-31T00:27:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 -- start start 2023-08-31T00:27:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b806f130 0x7fa2b81ebe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 0x7fa2b81f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2b81580f0 0x7fa2b81f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c7a80 con 0x7fa2b80711d0 2023-08-31T00:27:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c6e00 con 0x7fa2b81580f0 2023-08-31T00:27:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2be5f9700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b80c70e0 con 0x7fa2b806f130 2023-08-31T00:27:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.895+0000 7fa2b77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 0x7fa2b81f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 0x7fa2b81f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40058/0 (socket says 172.21.15.77:40058) 2023-08-31T00:27:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 -- 172.21.15.77:0/718600297 learned_addr learned my addr 172.21.15.77:0/718600297 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2bcb96700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2b81580f0 0x7fa2b81f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b7fff700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b806f130 0x7fa2b81ebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 -- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b806f130 msgr2=0x7fa2b81ebe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b806f130 0x7fa2b81ebe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 -- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2b81580f0 msgr2=0x7fa2b81f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2b81580f0 0x7fa2b81f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 -- 172.21.15.77:0/718600297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0095f0 con 0x7fa2b80711d0 2023-08-31T00:27:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b7fff700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b806f130 0x7fa2b81ebe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b77fe700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 0x7fa2b81f1f90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c4e0 tx=0x7fa2a800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80052d0 con 0x7fa2b80711d0 2023-08-31T00:27:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2a8005520 con 0x7fa2b80711d0 2023-08-31T00:27:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b80c73c0 con 0x7fa2b80711d0 2023-08-31T00:27:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80038e0 con 0x7fa2b80711d0 2023-08-31T00:27:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.896+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b81ec350 con 0x7fa2b80711d0 2023-08-31T00:27:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.897+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b80c7bc0 con 0x7fa2b80711d0 2023-08-31T00:27:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.897+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2a8003a40 con 0x7fa2b80711d0 2023-08-31T00:27:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.898+0000 7fa2b4ff9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa2a406a0e0 0x7fa2a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.898+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa2a8087b40 con 0x7fa2b80711d0 2023-08-31T00:27:43.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.898+0000 7fa2b7fff700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa2a406a0e0 0x7fa2a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:43.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.898+0000 7fa2b7fff700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa2a406a0e0 0x7fa2a406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0098e0 tx=0x7fa2ac011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:43.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:43.902+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2b80c7bc0 con 0x7fa2b80711d0 2023-08-31T00:27:44.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.097+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2b80c7bc0 con 0x7fa2b80711d0 2023-08-31T00:27:44.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.098+0000 7fa2b4ff9700 1 -- 172.21.15.77:0/718600297 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16743 (secure 0 0 0) 0x7fa2b80c7bc0 con 0x7fa2b80711d0 2023-08-31T00:27:44.099 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:44.100 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:41.588266+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:44.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa2a406a0e0 msgr2=0x7fa2a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa2a406a0e0 0x7fa2a406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0098e0 tx=0x7fa2ac011040 comp rx=0 tx=0).stop 2023-08-31T00:27:44.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 msgr2=0x7fa2b81f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 0x7fa2b81f1f90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c4e0 tx=0x7fa2a800c7f0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 shutdown_connections 2023-08-31T00:27:44.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa2a406a0e0 0x7fa2a406c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa2b806f130 0x7fa2b81ebe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2b81580f0 0x7fa2b81f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 --2- 172.21.15.77:0/718600297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2b80711d0 0x7fa2b81f1f90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 >> 172.21.15.77:0/718600297 conn(0x7fa2b806cbf0 msgr2=0x7fa2b80adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:44.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 shutdown_connections 2023-08-31T00:27:44.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.101+0000 7fa2be5f9700 1 -- 172.21.15.77:0/718600297 wait complete. 2023-08-31T00:27:44.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:44.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f4587baf700 1 -- 172.21.15.77:0/2612668776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f456c003a00 msgr2=0x7f456c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f4587baf700 1 --2- 172.21.15.77:0/2612668776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f456c003a00 0x7f456c003e20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bc60 tx=0x7f456c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f458614c700 1 -- 172.21.15.77:0/2612668776 reap_dead start 2023-08-31T00:27:44.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f4587baf700 1 -- 172.21.15.77:0/2612668776 shutdown_connections 2023-08-31T00:27:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f4587baf700 1 -- 172.21.15.77:0/2612668776 >> 172.21.15.77:0/2612668776 conn(0x7f4580070270 msgr2=0x7f4580070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f4587baf700 1 -- 172.21.15.77:0/2612668776 shutdown_connections 2023-08-31T00:27:44.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.240+0000 7f4587baf700 1 -- 172.21.15.77:0/2612668776 wait complete. 2023-08-31T00:27:44.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.241+0000 7f4587baf700 1 Processor -- start 2023-08-31T00:27:44.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.241+0000 7f4587baf700 1 -- start start 2023-08-31T00:27:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f456c003a00 0x7f4580159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 0x7f45800c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45800aaa00 0x7f45800aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45801f6050 con 0x7f45800c1f90 2023-08-31T00:27:44.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45801f1f30 con 0x7f456c003a00 2023-08-31T00:27:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45801f5d70 con 0x7f45800aaa00 2023-08-31T00:27:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 0x7f45800c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 0x7f45800c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40078/0 (socket says 172.21.15.77:40078) 2023-08-31T00:27:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 -- 172.21.15.77:0/4175359463 learned_addr learned my addr 172.21.15.77:0/4175359463 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:44.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458614c700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45800aaa00 0x7f45800aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458594b700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f456c003a00 0x7f4580159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 -- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45800aaa00 msgr2=0x7f45800aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45800aaa00 0x7f45800aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 -- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f456c003a00 msgr2=0x7f4580159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f456c003a00 0x7f4580159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 -- 172.21.15.77:0/4175359463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800c14b0 con 0x7f45800c1f90 2023-08-31T00:27:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f458514a700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 0x7f45800c2410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4570006680 tx=0x7f4570003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570011840 con 0x7f45800c1f90 2023-08-31T00:27:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45700119a0 con 0x7f45800c1f90 2023-08-31T00:27:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45800c1790 con 0x7f45800c1f90 2023-08-31T00:27:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4570011db0 con 0x7f45800c1f90 2023-08-31T00:27:44.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.242+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45800c35f0 con 0x7f45800c1f90 2023-08-31T00:27:44.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.243+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45800c1de0 con 0x7f45800c1f90 2023-08-31T00:27:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.244+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45700103c0 con 0x7f45800c1f90 2023-08-31T00:27:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.244+0000 7f45767fc700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f456406a0e0 0x7f456406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.244+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4570089570 con 0x7f45800c1f90 2023-08-31T00:27:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.244+0000 7f458594b700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f456406a0e0 0x7f456406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.244+0000 7f458594b700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f456406a0e0 0x7f456406c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bfd0 tx=0x7f457c004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.248+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4570054d60 con 0x7f45800c1f90 2023-08-31T00:27:44.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.435+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45800acba0 con 0x7f45800c1f90 2023-08-31T00:27:44.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.435+0000 7f45767fc700 1 -- 172.21.15.77:0/4175359463 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f457001f0a0 con 0x7f45800c1f90 2023-08-31T00:27:44.436 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f456406a0e0 msgr2=0x7f456406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f456406a0e0 0x7f456406c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bfd0 tx=0x7f457c004750 comp rx=0 tx=0).stop 2023-08-31T00:27:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 msgr2=0x7f45800c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 0x7f45800c2410 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4570006680 tx=0x7f4570003960 comp rx=0 tx=0).stop 2023-08-31T00:27:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 shutdown_connections 2023-08-31T00:27:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f456406a0e0 0x7f456406c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f45800aaa00 0x7f45800aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f456c003a00 0x7f4580159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 --2- 172.21.15.77:0/4175359463 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45800c1f90 0x7f45800c2410 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 >> 172.21.15.77:0/4175359463 conn(0x7f4580070270 msgr2=0x7f45800c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 shutdown_connections 2023-08-31T00:27:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.437+0000 7f4587baf700 1 -- 172.21.15.77:0/4175359463 wait complete. 2023-08-31T00:27:44.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:44.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f2b40700 1 -- 172.21.15.77:0/3070084176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4dc004850 msgr2=0x7fc4dc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/3070084176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4dc004850 0x7fc4dc004cd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009be0 tx=0x7fc4dc005880 comp rx=0 tx=0).stop 2023-08-31T00:27:44.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f10dd700 1 -- 172.21.15.77:0/3070084176 reap_dead start 2023-08-31T00:27:44.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f2b40700 1 -- 172.21.15.77:0/3070084176 shutdown_connections 2023-08-31T00:27:44.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f2b40700 1 -- 172.21.15.77:0/3070084176 >> 172.21.15.77:0/3070084176 conn(0x7fc4ec06cbf0 msgr2=0x7fc4ec06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:44.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f2b40700 1 -- 172.21.15.77:0/3070084176 shutdown_connections 2023-08-31T00:27:44.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.576+0000 7fc4f2b40700 1 -- 172.21.15.77:0/3070084176 wait complete. 2023-08-31T00:27:44.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.577+0000 7fc4f2b40700 1 Processor -- start 2023-08-31T00:27:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.577+0000 7fc4f2b40700 1 -- start start 2023-08-31T00:27:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f2b40700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4dc004850 0x7fc4ec0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f2b40700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4ec0c3e90 0x7fc4ec0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f2b40700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 0x7fc4ec1ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f2b40700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c50f0 con 0x7fc4ec0c4310 2023-08-31T00:27:44.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f2b40700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c5340 con 0x7fc4dc004850 2023-08-31T00:27:44.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f2b40700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c5620 con 0x7fc4ec0c3e90 2023-08-31T00:27:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f10dd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 0x7fc4ec1ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f10dd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 0x7fc4ec1ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40098/0 (socket says 172.21.15.77:40098) 2023-08-31T00:27:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f10dd700 1 -- 172.21.15.77:0/845847828 learned_addr learned my addr 172.21.15.77:0/845847828 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4f08dc700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4dc004850 0x7fc4ec0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.578+0000 7fc4ebfff700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4ec0c3e90 0x7fc4ec0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f10dd700 1 -- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4ec0c3e90 msgr2=0x7fc4ec0c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f10dd700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4ec0c3e90 0x7fc4ec0c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f10dd700 1 -- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4dc004850 msgr2=0x7fc4ec0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f10dd700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4dc004850 0x7fc4ec0c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f10dd700 1 -- 172.21.15.77:0/845847828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0c5900 con 0x7fc4ec0c4310 2023-08-31T00:27:44.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4ebfff700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4ec0c3e90 0x7fc4ec0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:44.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f10dd700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 0x7fc4ec1ef8e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec071d50 tx=0x7fc4e400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:44.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400c9d0 con 0x7fc4ec0c4310 2023-08-31T00:27:44.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc4e400cc40 con 0x7fc4ec0c4310 2023-08-31T00:27:44.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec0c5be0 con 0x7fc4ec0c4310 2023-08-31T00:27:44.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400eec0 con 0x7fc4ec0c4310 2023-08-31T00:27:44.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.579+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec0c8370 con 0x7fc4ec0c4310 2023-08-31T00:27:44.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.580+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec0c6100 con 0x7fc4ec0c4310 2023-08-31T00:27:44.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.580+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc4e401d460 con 0x7fc4ec0c4310 2023-08-31T00:27:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.581+0000 7fc4e97fa700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc4d006a0e0 0x7fc4d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.581+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc4e4088a50 con 0x7fc4ec0c4310 2023-08-31T00:27:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.581+0000 7fc4f08dc700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc4d006a0e0 0x7fc4d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.581+0000 7fc4f08dc700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc4d006a0e0 0x7fc4d006c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00044f0 tx=0x7fc4e0009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:44.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.585+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc4ec0c6100 con 0x7fc4ec0c4310 2023-08-31T00:27:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.776+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4ec0c6100 con 0x7fc4ec0c4310 2023-08-31T00:27:44.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.776+0000 7fc4e97fa700 1 -- 172.21.15.77:0/845847828 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4ec0c6100 con 0x7fc4ec0c4310 2023-08-31T00:27:44.778 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:44.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc4d006a0e0 msgr2=0x7fc4d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc4d006a0e0 0x7fc4d006c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00044f0 tx=0x7fc4e0009260 comp rx=0 tx=0).stop 2023-08-31T00:27:44.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 msgr2=0x7fc4ec1ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 0x7fc4ec1ef8e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec071d50 tx=0x7fc4e400ec80 comp rx=0 tx=0).stop 2023-08-31T00:27:44.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 shutdown_connections 2023-08-31T00:27:44.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc4d006a0e0 0x7fc4d006c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4ec0c4310 0x7fc4ec1ef8e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4dc004850 0x7fc4ec0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 --2- 172.21.15.77:0/845847828 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4ec0c3e90 0x7fc4ec0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 >> 172.21.15.77:0/845847828 conn(0x7fc4ec06cbf0 msgr2=0x7fc4ec1588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:44.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 shutdown_connections 2023-08-31T00:27:44.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.779+0000 7fc4f2b40700 1 -- 172.21.15.77:0/845847828 wait complete. 2023-08-31T00:27:44.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:44.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.919+0000 7fc097d47700 1 -- 172.21.15.77:0/3635191298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 msgr2=0x7fc07c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.919+0000 7fc097d47700 1 --2- 172.21.15.77:0/3635191298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc07c005210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc0900afba0 tx=0x7fc07c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:44.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.919+0000 7fc0962e4700 1 -- 172.21.15.77:0/3635191298 reap_dead start 2023-08-31T00:27:44.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.919+0000 7fc097d47700 1 -- 172.21.15.77:0/3635191298 shutdown_connections 2023-08-31T00:27:44.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.919+0000 7fc097d47700 1 -- 172.21.15.77:0/3635191298 >> 172.21.15.77:0/3635191298 conn(0x7fc09006cbf0 msgr2=0x7fc09006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:44.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.920+0000 7fc097d47700 1 -- 172.21.15.77:0/3635191298 shutdown_connections 2023-08-31T00:27:44.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.920+0000 7fc097d47700 1 -- 172.21.15.77:0/3635191298 wait complete. 2023-08-31T00:27:44.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.921+0000 7fc097d47700 1 Processor -- start 2023-08-31T00:27:44.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.921+0000 7fc097d47700 1 -- start start 2023-08-31T00:27:44.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc097d47700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc0900c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc097d47700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0900ade50 0x7fc09014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc097d47700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0901f3430 0x7fc0901f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc097d47700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc090150700 con 0x7fc07c004d90 2023-08-31T00:27:44.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc097d47700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901f2d00 con 0x7fc0900ade50 2023-08-31T00:27:44.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc097d47700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900ae2d0 con 0x7fc0901f3430 2023-08-31T00:27:44.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc0900c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc0900c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40116/0 (socket says 172.21.15.77:40116) 2023-08-31T00:27:44.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 -- 172.21.15.77:0/2026042941 learned_addr learned my addr 172.21.15.77:0/2026042941 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:44.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 -- 172.21.15.77:0/2026042941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0901f3430 msgr2=0x7fc0901f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0901f3430 0x7fc0901f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 -- 172.21.15.77:0/2026042941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0900ade50 msgr2=0x7fc09014bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:44.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0900ade50 0x7fc09014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:44.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.922+0000 7fc095ae3700 1 -- 172.21.15.77:0/2026042941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090158630 con 0x7fc07c004d90 2023-08-31T00:27:44.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.923+0000 7fc095ae3700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc0900c7db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc084003f80 tx=0x7fc084001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:44.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.923+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084006230 con 0x7fc07c004d90 2023-08-31T00:27:44.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.923+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc084011840 con 0x7fc07c004d90 2023-08-31T00:27:44.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.923+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0900ae5a0 con 0x7fc07c004d90 2023-08-31T00:27:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.923+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011c30 con 0x7fc07c004d90 2023-08-31T00:27:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.923+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0900aeb60 con 0x7fc07c004d90 2023-08-31T00:27:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.924+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0900aed80 con 0x7fc07c004d90 2023-08-31T00:27:44.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.924+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc0840103c0 con 0x7fc07c004d90 2023-08-31T00:27:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.924+0000 7fc0827fc700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc07406a0e0 0x7fc07406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.925+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc084089420 con 0x7fc07c004d90 2023-08-31T00:27:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.925+0000 7fc0952e2700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc07406a0e0 0x7fc07406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.925+0000 7fc0952e2700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc07406a0e0 0x7fc07406c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc08c001c80 tx=0x7fc08c001b70 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:44.929+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc084054b80 con 0x7fc07c004d90 2023-08-31T00:27:45.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.116+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc090151af0 con 0x7fc07c004d90 2023-08-31T00:27:45.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.116+0000 7fc0827fc700 1 -- 172.21.15.77:0/2026042941 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc08401f0a0 con 0x7fc07c004d90 2023-08-31T00:27:45.118 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:45.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.118+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc07406a0e0 msgr2=0x7fc07406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.118+0000 7fc097d47700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc07406a0e0 0x7fc07406c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc08c001c80 tx=0x7fc08c001b70 comp rx=0 tx=0).stop 2023-08-31T00:27:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 msgr2=0x7fc0900c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc0900c7db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc084003f80 tx=0x7fc084001720 comp rx=0 tx=0).stop 2023-08-31T00:27:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 shutdown_connections 2023-08-31T00:27:45.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc07406a0e0 0x7fc07406c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc0901f3430 0x7fc0901f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc07c004d90 0x7fc0900c7db0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 --2- 172.21.15.77:0/2026042941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0900ade50 0x7fc09014bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 >> 172.21.15.77:0/2026042941 conn(0x7fc09006cbf0 msgr2=0x7fc0900cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:45.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 shutdown_connections 2023-08-31T00:27:45.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.119+0000 7fc097d47700 1 -- 172.21.15.77:0/2026042941 wait complete. 2023-08-31T00:27:45.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:45.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 -- 172.21.15.77:0/2504490517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e01580f0 msgr2=0x7f56e00cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/2504490517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e01580f0 0x7f56e00cc250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56e00c1750 tx=0x7f56d0009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 -- 172.21.15.77:0/2504490517 shutdown_connections 2023-08-31T00:27:45.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/2504490517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e01580f0 0x7f56e00cc250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/2504490517 >> v2:172.21.15.139:3300/0 conn(0x7f56e006f130 0x7f56e0070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 -- 172.21.15.77:0/2504490517 >> 172.21.15.77:0/2504490517 conn(0x7f56e006cbf0 msgr2=0x7f56e006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:45.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 -- 172.21.15.77:0/2504490517 shutdown_connections 2023-08-31T00:27:45.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.254+0000 7f56e7c8a700 1 -- 172.21.15.77:0/2504490517 wait complete. 2023-08-31T00:27:45.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 Processor -- start 2023-08-31T00:27:45.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 -- start start 2023-08-31T00:27:45.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56e006f130 0x7f56e01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 0x7f56e00c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56e01580f0 0x7f56e01f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c31f0 con 0x7f56e0071000 2023-08-31T00:27:45.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c6190 con 0x7f56e01580f0 2023-08-31T00:27:45.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e7c8a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c6470 con 0x7f56e006f130 2023-08-31T00:27:45.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e5225700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 0x7f56e00c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e5225700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 0x7f56e00c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40132/0 (socket says 172.21.15.77:40132) 2023-08-31T00:27:45.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.256+0000 7f56e5225700 1 -- 172.21.15.77:0/3266279040 learned_addr learned my addr 172.21.15.77:0/3266279040 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:45.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5a26700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56e006f130 0x7f56e01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e6227700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56e01580f0 0x7f56e01f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5225700 1 -- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56e006f130 msgr2=0x7f56e01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5225700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56e006f130 0x7f56e01523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5225700 1 -- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56e01580f0 msgr2=0x7f56e01f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5225700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56e01580f0 0x7f56e01f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5225700 1 -- 172.21.15.77:0/3266279040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009520 con 0x7f56e0071000 2023-08-31T00:27:45.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e5225700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 0x7f56e00c5b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d950 tx=0x7f56dc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:45.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc009b40 con 0x7f56e0071000 2023-08-31T00:27:45.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56dc009d90 con 0x7f56e0071000 2023-08-31T00:27:45.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0106c0 con 0x7f56e0071000 2023-08-31T00:27:45.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e00c2ba0 con 0x7f56e0071000 2023-08-31T00:27:45.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.257+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e01e1900 con 0x7f56e0071000 2023-08-31T00:27:45.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.258+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e0073c30 con 0x7f56e0071000 2023-08-31T00:27:45.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.258+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f56dc010820 con 0x7f56e0071000 2023-08-31T00:27:45.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.259+0000 7f56d67fc700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56c406a0e0 0x7f56c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.259+0000 7f56e5a26700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56c406a0e0 0x7f56c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.259+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f56dc088ab0 con 0x7f56e0071000 2023-08-31T00:27:45.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.259+0000 7f56e5a26700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56c406a0e0 0x7f56c406c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56e0156630 tx=0x7f56d0019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:45.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.263+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f56dc0542a0 con 0x7f56e0071000 2023-08-31T00:27:45.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.471+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f56e0069cb0 con 0x7f56e0071000 2023-08-31T00:27:45.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.472+0000 7f56d67fc700 1 -- 172.21.15.77:0/3266279040 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f56dc020080 con 0x7f56e0071000 2023-08-31T00:27:45.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56c406a0e0 msgr2=0x7f56c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56c406a0e0 0x7f56c406c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56e0156630 tx=0x7f56d0019040 comp rx=0 tx=0).stop 2023-08-31T00:27:45.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 msgr2=0x7f56e00c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 0x7f56e00c5b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d950 tx=0x7f56dc00dd10 comp rx=0 tx=0).stop 2023-08-31T00:27:45.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 shutdown_connections 2023-08-31T00:27:45.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56c406a0e0 0x7f56c406c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56e006f130 0x7f56e01523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56e01580f0 0x7f56e01f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 --2- 172.21.15.77:0/3266279040 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56e0071000 0x7f56e00c5b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 >> 172.21.15.77:0/3266279040 conn(0x7f56e006cbf0 msgr2=0x7f56e006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:45.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 shutdown_connections 2023-08-31T00:27:45.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.474+0000 7f56e7c8a700 1 -- 172.21.15.77:0/3266279040 wait complete. 2023-08-31T00:27:45.478 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:45.487 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-08-31T00:27:45.487 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T00:27:45.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:45.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 -- 172.21.15.77:0/349385741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310806f130 msgr2=0x7f3108070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 --2- 172.21.15.77:0/349385741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310806f130 0x7f3108070ac0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098c0 tx=0x7f30f4009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 -- 172.21.15.77:0/349385741 shutdown_connections 2023-08-31T00:27:45.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 --2- 172.21.15.77:0/349385741 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f310806f130 0x7f3108070ac0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 -- 172.21.15.77:0/349385741 >> 172.21.15.77:0/349385741 conn(0x7f310806cbf0 msgr2=0x7f310806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:45.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 -- 172.21.15.77:0/349385741 shutdown_connections 2023-08-31T00:27:45.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.632+0000 7f310ee1f700 1 -- 172.21.15.77:0/349385741 wait complete. 2023-08-31T00:27:45.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.633+0000 7f310ee1f700 1 Processor -- start 2023-08-31T00:27:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.634+0000 7f310ee1f700 1 -- start start 2023-08-31T00:27:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f310806f130 0x7f31080aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3108071000 0x7f3108152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 0x7f3108069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31080c5200 con 0x7f31081580f0 2023-08-31T00:27:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31081e0cd0 con 0x7f3108071000 2023-08-31T00:27:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31080ab150 con 0x7f310806f130 2023-08-31T00:27:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 0x7f3108069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 0x7f3108069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40148/0 (socket says 172.21.15.77:40148) 2023-08-31T00:27:45.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 -- 172.21.15.77:0/1213397717 learned_addr learned my addr 172.21.15.77:0/1213397717 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:45.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f3107fff700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3108071000 0x7f3108152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310cbbb700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f310806f130 0x7f31080aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 -- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f310806f130 msgr2=0x7f31080aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f310806f130 0x7f31080aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 -- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3108071000 msgr2=0x7f3108152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3108071000 0x7f3108152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 -- 172.21.15.77:0/1213397717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009520 con 0x7f31081580f0 2023-08-31T00:27:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f3107fff700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3108071000 0x7f3108152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310d3bc700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 0x7f3108069b10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f310000c7f0 tx=0x7f310000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:45.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100003e30 con 0x7f31081580f0 2023-08-31T00:27:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3100005070 con 0x7f31081580f0 2023-08-31T00:27:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31080ab430 con 0x7f31081580f0 2023-08-31T00:27:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100005480 con 0x7f31081580f0 2023-08-31T00:27:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.635+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31080ab7c0 con 0x7f31081580f0 2023-08-31T00:27:45.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.636+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31081e0e60 con 0x7f31081580f0 2023-08-31T00:27:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.637+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31000055e0 con 0x7f31081580f0 2023-08-31T00:27:45.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.637+0000 7f31057fa700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.637+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3100088250 con 0x7f31081580f0 2023-08-31T00:27:45.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.637+0000 7f310cbbb700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.638+0000 7f310cbbb700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009870 tx=0x7f30fc008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:45.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.641+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3100053920 con 0x7f31081580f0 2023-08-31T00:27:45.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.831+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3108071450 con 0x7f31081580f0 2023-08-31T00:27:45.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.832+0000 7f31057fa700 1 -- 172.21.15.77:0/1213397717 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16743 (secure 0 0 0) 0x7f3108071450 con 0x7f31081580f0 2023-08-31T00:27:45.834 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:45.834 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:41.588266+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:45.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f30ec06a0e0 msgr2=0x7f30ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009870 tx=0x7f30fc008040 comp rx=0 tx=0).stop 2023-08-31T00:27:45.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 msgr2=0x7f3108069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 0x7f3108069b10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f310000c7f0 tx=0x7f310000cbb0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 shutdown_connections 2023-08-31T00:27:45.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f30ec06a0e0 0x7f30ec06c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f310806f130 0x7f31080aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31081580f0 0x7f3108069b10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 --2- 172.21.15.77:0/1213397717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3108071000 0x7f3108152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 >> 172.21.15.77:0/1213397717 conn(0x7f310806cbf0 msgr2=0x7f3108159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:45.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 shutdown_connections 2023-08-31T00:27:45.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.835+0000 7f310ee1f700 1 -- 172.21.15.77:0/1213397717 wait complete. 2023-08-31T00:27:45.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:45.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:45.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 -- 172.21.15.77:0/1925957284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4380ce9c0 msgr2=0x7fe4380d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/1925957284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4380ce9c0 0x7fe4380d0f70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe430009f60 tx=0x7fe430009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:45.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 -- 172.21.15.77:0/1925957284 shutdown_connections 2023-08-31T00:27:45.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/1925957284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4380ce9c0 0x7fe4380d0f70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/1925957284 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43815b3d0 0x7fe4380cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 -- 172.21.15.77:0/1925957284 >> 172.21.15.77:0/1925957284 conn(0x7fe438071630 msgr2=0x7fe438071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:45.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 -- 172.21.15.77:0/1925957284 shutdown_connections 2023-08-31T00:27:45.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.975+0000 7fe43d8ef700 1 -- 172.21.15.77:0/1925957284 wait complete. 2023-08-31T00:27:45.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.976+0000 7fe43d8ef700 1 Processor -- start 2023-08-31T00:27:45.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.976+0000 7fe43d8ef700 1 -- start start 2023-08-31T00:27:45.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 0x7fe4381548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe4380ce9c0 0x7fe4380b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43815b3d0 0x7fe4380b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380c4910 con 0x7fe4380b04a0 2023-08-31T00:27:45.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe438146340 con 0x7fe43815b3d0 2023-08-31T00:27:45.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4381467d0 con 0x7fe4380ce9c0 2023-08-31T00:27:45.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 0x7fe4381548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 0x7fe4381548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40156/0 (socket says 172.21.15.77:40156) 2023-08-31T00:27:45.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 -- 172.21.15.77:0/2726691771 learned_addr learned my addr 172.21.15.77:0/2726691771 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:45.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe4377fe700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43815b3d0 0x7fe4380b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe4367fc700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe4380ce9c0 0x7fe4380b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 -- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe4380ce9c0 msgr2=0x7fe4380b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe4380ce9c0 0x7fe4380b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 -- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43815b3d0 msgr2=0x7fe4380b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:45.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43815b3d0 0x7fe4380b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:45.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 -- 172.21.15.77:0/2726691771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0095f0 con 0x7fe4380b04a0 2023-08-31T00:27:45.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe4367fc700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe4380ce9c0 0x7fe4380b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:45.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe436ffd700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 0x7fe4381548a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00eb70 tx=0x7fe42c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:45.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c009970 con 0x7fe4380b04a0 2023-08-31T00:27:45.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe42c00cc90 con 0x7fe4380b04a0 2023-08-31T00:27:45.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe430009c40 con 0x7fe4380b04a0 2023-08-31T00:27:45.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c004280 con 0x7fe4380b04a0 2023-08-31T00:27:45.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.977+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe438145cf0 con 0x7fe4380b04a0 2023-08-31T00:27:45.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.978+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe438146620 con 0x7fe4380b04a0 2023-08-31T00:27:45.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.979+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe42c0043e0 con 0x7fe4380b04a0 2023-08-31T00:27:45.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.979+0000 7fe41ffff700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42406a0e0 0x7fe42406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:45.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.979+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe42c014070 con 0x7fe4380b04a0 2023-08-31T00:27:45.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.979+0000 7fe4367fc700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42406a0e0 0x7fe42406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:45.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.980+0000 7fe4367fc700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42406a0e0 0x7fe42406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe43815bff0 tx=0x7fe428009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:45.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:45.984+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe42c058210 con 0x7fe4380b04a0 2023-08-31T00:27:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.174+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4380cc970 con 0x7fe4380b04a0 2023-08-31T00:27:46.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.175+0000 7fe41ffff700 1 -- 172.21.15.77:0/2726691771 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe42c057da0 con 0x7fe4380b04a0 2023-08-31T00:27:46.177 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42406a0e0 msgr2=0x7fe42406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42406a0e0 0x7fe42406c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe43815bff0 tx=0x7fe428009040 comp rx=0 tx=0).stop 2023-08-31T00:27:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 msgr2=0x7fe4381548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 0x7fe4381548a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00eb70 tx=0x7fe42c00ee80 comp rx=0 tx=0).stop 2023-08-31T00:27:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 shutdown_connections 2023-08-31T00:27:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42406a0e0 0x7fe42406c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43815b3d0 0x7fe4380b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4380b04a0 0x7fe4381548a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 --2- 172.21.15.77:0/2726691771 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe4380ce9c0 0x7fe4380b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 >> 172.21.15.77:0/2726691771 conn(0x7fe438071630 msgr2=0x7fe4380b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:46.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 shutdown_connections 2023-08-31T00:27:46.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.177+0000 7fe43d8ef700 1 -- 172.21.15.77:0/2726691771 wait complete. 2023-08-31T00:27:46.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:46.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 -- 172.21.15.77:0/689612943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 msgr2=0x7fe49c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 --2- 172.21.15.77:0/689612943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c0cc250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0c1750 tx=0x7fe484009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:46.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 -- 172.21.15.77:0/689612943 shutdown_connections 2023-08-31T00:27:46.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 --2- 172.21.15.77:0/689612943 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 0x7fe49c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 --2- 172.21.15.77:0/689612943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c0cc250 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 --2- 172.21.15.77:0/689612943 >> v2:172.21.15.139:3300/0 conn(0x7fe49c06f130 0x7fe49c070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 -- 172.21.15.77:0/689612943 >> 172.21.15.77:0/689612943 conn(0x7fe49c06cbf0 msgr2=0x7fe49c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:46.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 -- 172.21.15.77:0/689612943 shutdown_connections 2023-08-31T00:27:46.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.313+0000 7fe4a202e700 1 -- 172.21.15.77:0/689612943 wait complete. 2023-08-31T00:27:46.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.315+0000 7fe4a202e700 1 Processor -- start 2023-08-31T00:27:46.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.315+0000 7fe4a202e700 1 -- start start 2023-08-31T00:27:46.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe4a202e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe49c06f130 0x7fe49c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe4a202e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 0x7fe49c1f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe4a202e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe4a202e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c14efa0 con 0x7fe49c1580f0 2023-08-31T00:27:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe4a202e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1513c0 con 0x7fe49c06f130 2023-08-31T00:27:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe4a202e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1516a0 con 0x7fe49c071000 2023-08-31T00:27:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c14f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40174/0 (socket says 172.21.15.77:40174) 2023-08-31T00:27:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 -- 172.21.15.77:0/1446806002 learned_addr learned my addr 172.21.15.77:0/1446806002 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49b7fe700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe49c06f130 0x7fe49c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49affd700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 0x7fe49c1f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 -- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 msgr2=0x7fe49c1f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 0x7fe49c1f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 -- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe49c06f130 msgr2=0x7fe49c14d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe49c06f130 0x7fe49c14d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49bfff700 1 -- 172.21.15.77:0/1446806002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4840095f0 con 0x7fe49c1580f0 2023-08-31T00:27:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.316+0000 7fe49affd700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 0x7fe49c1f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:46.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.317+0000 7fe49bfff700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c14f3c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe49400b970 tx=0x7fe49400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:46.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.317+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400c930 con 0x7fe49c1580f0 2023-08-31T00:27:46.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.317+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe49400cba0 con 0x7fe49c1580f0 2023-08-31T00:27:46.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.317+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c151980 con 0x7fe49c1580f0 2023-08-31T00:27:46.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.317+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494014440 con 0x7fe49c1580f0 2023-08-31T00:27:46.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.317+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c150f30 con 0x7fe49c1580f0 2023-08-31T00:27:46.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.318+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c14f0e0 con 0x7fe49c1580f0 2023-08-31T00:27:46.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.318+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe49401d3b0 con 0x7fe49c1580f0 2023-08-31T00:27:46.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.318+0000 7fe493fff700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe47c06a0e0 0x7fe47c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.319+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe494006e40 con 0x7fe49c1580f0 2023-08-31T00:27:46.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.319+0000 7fe49b7fe700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe47c06a0e0 0x7fe47c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.319+0000 7fe49b7fe700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe47c06a0e0 0x7fe47c06c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4840098e0 tx=0x7fe484019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:46.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.323+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe49c14f0e0 con 0x7fe49c1580f0 2023-08-31T00:27:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.514+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe49c14f0e0 con 0x7fe49c1580f0 2023-08-31T00:27:46.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.514+0000 7fe493fff700 1 -- 172.21.15.77:0/1446806002 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe49c14f0e0 con 0x7fe49c1580f0 2023-08-31T00:27:46.515 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe47c06a0e0 msgr2=0x7fe47c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe47c06a0e0 0x7fe47c06c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4840098e0 tx=0x7fe484019040 comp rx=0 tx=0).stop 2023-08-31T00:27:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 msgr2=0x7fe49c14f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c14f3c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe49400b970 tx=0x7fe49400bc80 comp rx=0 tx=0).stop 2023-08-31T00:27:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 shutdown_connections 2023-08-31T00:27:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe47c06a0e0 0x7fe47c06c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe49c1580f0 0x7fe49c14f3c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe49c06f130 0x7fe49c14d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 --2- 172.21.15.77:0/1446806002 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe49c071000 0x7fe49c1f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 >> 172.21.15.77:0/1446806002 conn(0x7fe49c06cbf0 msgr2=0x7fe49c15a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 shutdown_connections 2023-08-31T00:27:46.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.516+0000 7fe4a202e700 1 -- 172.21.15.77:0/1446806002 wait complete. 2023-08-31T00:27:46.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 -- 172.21.15.77:0/3928165711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1015dc10 msgr2=0x7fcd10159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 --2- 172.21.15.77:0/3928165711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1015dc10 0x7fcd10159e50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcd100cfe70 tx=0x7fcd0800b380 comp rx=0 tx=0).stop 2023-08-31T00:27:46.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 -- 172.21.15.77:0/3928165711 shutdown_connections 2023-08-31T00:27:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 --2- 172.21.15.77:0/3928165711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd1015dc10 0x7fcd10159e50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 --2- 172.21.15.77:0/3928165711 >> v2:172.21.15.139:3300/0 conn(0x7fcd100c9ee0 0x7fcd10159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 -- 172.21.15.77:0/3928165711 >> 172.21.15.77:0/3928165711 conn(0x7fcd100cf180 msgr2=0x7fcd100cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:46.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 -- 172.21.15.77:0/3928165711 shutdown_connections 2023-08-31T00:27:46.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.656+0000 7fcd17392700 1 -- 172.21.15.77:0/3928165711 wait complete. 2023-08-31T00:27:46.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.657+0000 7fcd17392700 1 Processor -- start 2023-08-31T00:27:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.657+0000 7fcd17392700 1 -- start start 2023-08-31T00:27:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 0x7fcd100b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd10159530 0x7fcd10153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd1015dc10 0x7fcd100afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100b40c0 con 0x7fcd100c9ee0 2023-08-31T00:27:46.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100b0120 con 0x7fcd1015dc10 2023-08-31T00:27:46.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100b34b0 con 0x7fcd10159530 2023-08-31T00:27:46.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 0x7fcd100b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 0x7fcd100b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40184/0 (socket says 172.21.15.77:40184) 2023-08-31T00:27:46.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 -- 172.21.15.77:0/1470041913 learned_addr learned my addr 172.21.15.77:0/1470041913 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:46.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1592f700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd1015dc10 0x7fcd100afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1492d700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd10159530 0x7fcd10153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 -- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd10159530 msgr2=0x7fcd10153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd10159530 0x7fcd10153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 -- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd1015dc10 msgr2=0x7fcd100afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd1015dc10 0x7fcd100afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 -- 172.21.15.77:0/1470041913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08009d00 con 0x7fcd100c9ee0 2023-08-31T00:27:46.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd1512e700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 0x7fcd100b2df0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000c4a0 tx=0x7fcd0000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:46.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd000054e0 con 0x7fcd100c9ee0 2023-08-31T00:27:46.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcd00003680 con 0x7fcd100c9ee0 2023-08-31T00:27:46.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00003a90 con 0x7fcd100c9ee0 2023-08-31T00:27:46.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.658+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd100b3790 con 0x7fcd100c9ee0 2023-08-31T00:27:46.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.659+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd100b3d50 con 0x7fcd100c9ee0 2023-08-31T00:27:46.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.659+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd10073c30 con 0x7fcd100c9ee0 2023-08-31T00:27:46.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.660+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd00003bf0 con 0x7fcd100c9ee0 2023-08-31T00:27:46.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.660+0000 7fcd05ffb700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fccf406a0e0 0x7fccf406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.660+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcd00087680 con 0x7fcd100c9ee0 2023-08-31T00:27:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.660+0000 7fcd1492d700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fccf406a0e0 0x7fccf406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.661+0000 7fcd1492d700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fccf406a0e0 0x7fccf406c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006fd0 tx=0x7fcd0c008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:46.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.665+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd00052e70 con 0x7fcd100c9ee0 2023-08-31T00:27:46.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.851+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd1015a3e0 con 0x7fcd100c9ee0 2023-08-31T00:27:46.852 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.852+0000 7fcd05ffb700 1 -- 172.21.15.77:0/1470041913 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd00056490 con 0x7fcd100c9ee0 2023-08-31T00:27:46.853 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:46.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.853+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fccf406a0e0 msgr2=0x7fccf406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.853+0000 7fcd17392700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fccf406a0e0 0x7fccf406c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006fd0 tx=0x7fcd0c008040 comp rx=0 tx=0).stop 2023-08-31T00:27:46.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.853+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 msgr2=0x7fcd100b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.853+0000 7fcd17392700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 0x7fcd100b2df0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000c4a0 tx=0x7fcd0000c860 comp rx=0 tx=0).stop 2023-08-31T00:27:46.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 shutdown_connections 2023-08-31T00:27:46.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fccf406a0e0 0x7fccf406c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd1015dc10 0x7fcd100afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd100c9ee0 0x7fcd100b2df0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 --2- 172.21.15.77:0/1470041913 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcd10159530 0x7fcd10153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 >> 172.21.15.77:0/1470041913 conn(0x7fcd100cf180 msgr2=0x7fcd101586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:46.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 shutdown_connections 2023-08-31T00:27:46.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.854+0000 7fcd17392700 1 -- 172.21.15.77:0/1470041913 wait complete. 2023-08-31T00:27:46.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T00:27:46.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 -- 172.21.15.77:0/1813347626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 msgr2=0x7f247c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 --2- 172.21.15.77:0/1813347626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c0cc250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f246c0098c0 tx=0x7f246c009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 -- 172.21.15.77:0/1813347626 shutdown_connections 2023-08-31T00:27:46.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 --2- 172.21.15.77:0/1813347626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c0cc250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 -- 172.21.15.77:0/1813347626 >> 172.21.15.77:0/1813347626 conn(0x7f247c06cbf0 msgr2=0x7f247c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:46.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 -- 172.21.15.77:0/1813347626 shutdown_connections 2023-08-31T00:27:46.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.989+0000 7f2483594700 1 -- 172.21.15.77:0/1813347626 wait complete. 2023-08-31T00:27:46.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.990+0000 7f2483594700 1 Processor -- start 2023-08-31T00:27:46.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.990+0000 7f2483594700 1 -- start start 2023-08-31T00:27:46.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2483594700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f247c06f130 0x7f247c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2483594700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f247c0711d0 0x7f247c141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2483594700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:46.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2483594700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0c70e0 con 0x7f247c1580f0 2023-08-31T00:27:46.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2483594700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1565a0 con 0x7f247c06f130 2023-08-31T00:27:46.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2483594700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0c7c40 con 0x7f247c0711d0 2023-08-31T00:27:46.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40202/0 (socket says 172.21.15.77:40202) 2023-08-31T00:27:46.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 -- 172.21.15.77:0/950400638 learned_addr learned my addr 172.21.15.77:0/950400638 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:46.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481330700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f247c06f130 0x7f247c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2480b2f700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f247c0711d0 0x7f247c141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:46.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 -- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f247c0711d0 msgr2=0x7f247c141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f247c0711d0 0x7f247c141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 -- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f247c06f130 msgr2=0x7f247c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:46.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f247c06f130 0x7f247c069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:46.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 -- 172.21.15.77:0/950400638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c009520 con 0x7f247c1580f0 2023-08-31T00:27:46.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481330700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f247c06f130 0x7f247c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:46.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.991+0000 7f2481b31700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c142050 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f247400cb40 tx=0x7f247400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:46.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.992+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400ab10 con 0x7f247c1580f0 2023-08-31T00:27:46.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.992+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f247400ad60 con 0x7f247c1580f0 2023-08-31T00:27:46.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.992+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c142590 con 0x7f247c1580f0 2023-08-31T00:27:46.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.992+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474012680 con 0x7f247c1580f0 2023-08-31T00:27:46.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.992+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c0c75f0 con 0x7f247c1580f0 2023-08-31T00:27:46.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.993+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c073c30 con 0x7f247c1580f0 2023-08-31T00:27:47.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.993+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f24740127e0 con 0x7f247c1580f0 2023-08-31T00:27:47.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.993+0000 7f2471ffb700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f246006a0e0 0x7f246006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.993+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2474088c60 con 0x7f247c1580f0 2023-08-31T00:27:47.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.993+0000 7f2481330700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f246006a0e0 0x7f246006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.994+0000 7f2481330700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f246006a0e0 0x7f246006c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f246c000c00 tx=0x7f246c011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:47.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:46.998+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2474054450 con 0x7f247c1580f0 2023-08-31T00:27:47.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.201+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f247c0c7d80 con 0x7f247c1580f0 2023-08-31T00:27:47.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.201+0000 7f2471ffb700 1 -- 172.21.15.77:0/950400638 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2474057a70 con 0x7f247c1580f0 2023-08-31T00:27:47.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f246006a0e0 msgr2=0x7f246006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f246006a0e0 0x7f246006c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f246c000c00 tx=0x7f246c011040 comp rx=0 tx=0).stop 2023-08-31T00:27:47.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 msgr2=0x7f247c142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c142050 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f247400cb40 tx=0x7f247400cf00 comp rx=0 tx=0).stop 2023-08-31T00:27:47.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 shutdown_connections 2023-08-31T00:27:47.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f246006a0e0 0x7f246006c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c1580f0 0x7f247c142050 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f247c06f130 0x7f247c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 --2- 172.21.15.77:0/950400638 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f247c0711d0 0x7f247c141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 >> 172.21.15.77:0/950400638 conn(0x7f247c06cbf0 msgr2=0x7f247c0acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:47.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 shutdown_connections 2023-08-31T00:27:47.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.203+0000 7f2483594700 1 -- 172.21.15.77:0/950400638 wait complete. 2023-08-31T00:27:47.207 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-08-31T00:27:47.216 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2023-08-31T00:27:47.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:47.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-08-31T00:27:47.266 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:47.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2023-08-31T00:27:47.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:27:47.267 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-31T00:27:47.287 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T00:27:47.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:47.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.410+0000 7f5718bac700 1 -- 172.21.15.77:0/750967432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56fc004850 msgr2=0x7f56fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.410+0000 7f5718bac700 1 --2- 172.21.15.77:0/750967432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56fc004850 0x7f56fc004cd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5708001720 tx=0x7f56fc005880 comp rx=0 tx=0).stop 2023-08-31T00:27:47.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.410+0000 7f5718bac700 1 -- 172.21.15.77:0/750967432 shutdown_connections 2023-08-31T00:27:47.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.410+0000 7f5718bac700 1 --2- 172.21.15.77:0/750967432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56fc004850 0x7f56fc004cd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.410+0000 7f5718bac700 1 -- 172.21.15.77:0/750967432 >> 172.21.15.77:0/750967432 conn(0x7f571406cbf0 msgr2=0x7f571406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:47.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.410+0000 7f5718bac700 1 -- 172.21.15.77:0/750967432 shutdown_connections 2023-08-31T00:27:47.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.411+0000 7f5718bac700 1 -- 172.21.15.77:0/750967432 wait complete. 2023-08-31T00:27:47.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.412+0000 7f5718bac700 1 Processor -- start 2023-08-31T00:27:47.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.412+0000 7f5718bac700 1 -- start start 2023-08-31T00:27:47.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56fc004850 0x7f57141e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57141463d0 0x7f57140c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 0x7f5714156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5714157040 con 0x7f5714156680 2023-08-31T00:27:47.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c37d0 con 0x7f57141463d0 2023-08-31T00:27:47.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c3ab0 con 0x7f56fc004850 2023-08-31T00:27:47.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 0x7f5714156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 0x7f5714156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40222/0 (socket says 172.21.15.77:40222) 2023-08-31T00:27:47.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 -- 172.21.15.77:0/3296063858 learned_addr learned my addr 172.21.15.77:0/3296063858 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:47.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f571259c700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56fc004850 0x7f57141e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5711d9b700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57141463d0 0x7f57140c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 -- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56fc004850 msgr2=0x7f57141e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56fc004850 0x7f57141e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 -- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57141463d0 msgr2=0x7f57140c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57141463d0 0x7f57140c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 -- 172.21.15.77:0/3296063858 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140c3d90 con 0x7f5714156680 2023-08-31T00:27:47.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5712d9d700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 0x7f5714156b00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f57140cb650 tx=0x7f570c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:47.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c019070 con 0x7f5714156680 2023-08-31T00:27:47.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f570c00f040 con 0x7f5714156680 2023-08-31T00:27:47.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c00e070 con 0x7f5714156680 2023-08-31T00:27:47.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140c4070 con 0x7f5714156680 2023-08-31T00:27:47.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.413+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140c34c0 con 0x7f5714156680 2023-08-31T00:27:47.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.414+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57140c4590 con 0x7f5714156680 2023-08-31T00:27:47.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.415+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f570c010600 con 0x7f5714156680 2023-08-31T00:27:47.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.415+0000 7f5702ffd700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56f406a0e0 0x7f56f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.415+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f570c088000 con 0x7f5714156680 2023-08-31T00:27:47.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.415+0000 7f571259c700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56f406a0e0 0x7f56f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.415+0000 7f571259c700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56f406a0e0 0x7f56f406c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5704001ce0 tx=0x7f5704000ed0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:47.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.419+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f57140c4590 con 0x7f5714156680 2023-08-31T00:27:47.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.655+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57140c4590 con 0x7f5714156680 2023-08-31T00:27:47.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.655+0000 7f5702ffd700 1 -- 172.21.15.77:0/3296063858 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f57140c4590 con 0x7f5714156680 2023-08-31T00:27:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:47.656 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:47.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.657+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56f406a0e0 msgr2=0x7f56f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.657+0000 7f5718bac700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56f406a0e0 0x7f56f406c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5704001ce0 tx=0x7f5704000ed0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.657+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 msgr2=0x7f5714156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.657+0000 7f5718bac700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 0x7f5714156b00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f57140cb650 tx=0x7f570c007df0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 shutdown_connections 2023-08-31T00:27:47.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f56f406a0e0 0x7f56f406c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f56fc004850 0x7f57141e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5714156680 0x7f5714156b00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 --2- 172.21.15.77:0/3296063858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57141463d0 0x7f57140c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 >> 172.21.15.77:0/3296063858 conn(0x7f571406cbf0 msgr2=0x7f57140cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:47.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 shutdown_connections 2023-08-31T00:27:47.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.658+0000 7f5718bac700 1 -- 172.21.15.77:0/3296063858 wait complete. 2023-08-31T00:27:47.662 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:47.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:47.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 -- 172.21.15.77:0/3025143127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a40caca0 msgr2=0x7fe5a41598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3025143127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a40caca0 0x7fe5a41598f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe5980098c0 tx=0x7fe598009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 -- 172.21.15.77:0/3025143127 shutdown_connections 2023-08-31T00:27:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3025143127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a40caca0 0x7fe5a41598f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3025143127 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5a40cb080 0x7fe5a40cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 -- 172.21.15.77:0/3025143127 >> 172.21.15.77:0/3025143127 conn(0x7fe5a406cbf0 msgr2=0x7fe5a406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 -- 172.21.15.77:0/3025143127 shutdown_connections 2023-08-31T00:27:47.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.792+0000 7fe5a905f700 1 -- 172.21.15.77:0/3025143127 wait complete. 2023-08-31T00:27:47.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.794+0000 7fe5a905f700 1 Processor -- start 2023-08-31T00:27:47.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.794+0000 7fe5a905f700 1 -- start start 2023-08-31T00:27:47.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a905f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 0x7fe5a40b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a905f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5a40caca0 0x7fe5a4151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a905f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5a40cb080 0x7fe5a40c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a905f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c3c90 con 0x7fe5a4069b10 2023-08-31T00:27:47.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a905f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4151dc0 con 0x7fe5a40caca0 2023-08-31T00:27:47.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a905f700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c3010 con 0x7fe5a40cb080 2023-08-31T00:27:47.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 0x7fe5a40b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 0x7fe5a40b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40232/0 (socket says 172.21.15.77:40232) 2023-08-31T00:27:47.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.795+0000 7fe5a2d9d700 1 -- 172.21.15.77:0/3624439957 learned_addr learned my addr 172.21.15.77:0/3624439957 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:47.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a2d9d700 1 -- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5a40cb080 msgr2=0x7fe5a40c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a359e700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5a40cb080 0x7fe5a40c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a259c700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5a40caca0 0x7fe5a4151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a2d9d700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5a40cb080 0x7fe5a40c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a2d9d700 1 -- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5a40caca0 msgr2=0x7fe5a4151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a2d9d700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5a40caca0 0x7fe5a4151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:47.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a2d9d700 1 -- 172.21.15.77:0/3624439957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598009520 con 0x7fe5a4069b10 2023-08-31T00:27:47.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a259c700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5a40caca0 0x7fe5a4151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:47.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a2d9d700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 0x7fe5a40b15c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe598009230 tx=0x7fe598017820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:47.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59801c070 con 0x7fe5a4069b10 2023-08-31T00:27:47.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe598017cd0 con 0x7fe5a4069b10 2023-08-31T00:27:47.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598004280 con 0x7fe5a4069b10 2023-08-31T00:27:47.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a40c32f0 con 0x7fe5a4069b10 2023-08-31T00:27:47.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.796+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40c38b0 con 0x7fe5a4069b10 2023-08-31T00:27:47.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.797+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a40c3dd0 con 0x7fe5a4069b10 2023-08-31T00:27:47.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.797+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe5980043e0 con 0x7fe5a4069b10 2023-08-31T00:27:47.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.798+0000 7fe58b7fe700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe59006a0e0 0x7fe59006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:47.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.798+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe598089dd0 con 0x7fe5a4069b10 2023-08-31T00:27:47.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.798+0000 7fe5a259c700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe59006a0e0 0x7fe59006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:47.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.798+0000 7fe5a259c700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe59006a0e0 0x7fe59006c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe59400a8f0 tx=0x7fe594008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:47.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.802+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe5980555c0 con 0x7fe5a4069b10 2023-08-31T00:27:47.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.995+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5a4073c30 con 0x7fe5a4069b10 2023-08-31T00:27:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.996+0000 7fe58b7fe700 1 -- 172.21.15.77:0/3624439957 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16743 (secure 0 0 0) 0x7fe59808b070 con 0x7fe5a4069b10 2023-08-31T00:27:47.997 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:47.997 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:41.588266+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:47.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe59006a0e0 msgr2=0x7fe59006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe59006a0e0 0x7fe59006c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe59400a8f0 tx=0x7fe594008040 comp rx=0 tx=0).stop 2023-08-31T00:27:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 msgr2=0x7fe5a40b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 0x7fe5a40b15c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe598009230 tx=0x7fe598017820 comp rx=0 tx=0).stop 2023-08-31T00:27:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 shutdown_connections 2023-08-31T00:27:47.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe59006a0e0 0x7fe59006c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5a40cb080 0x7fe5a40c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5a4069b10 0x7fe5a40b15c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 --2- 172.21.15.77:0/3624439957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5a40caca0 0x7fe5a4151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 >> 172.21.15.77:0/3624439957 conn(0x7fe5a406cbf0 msgr2=0x7fe5a4069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:48.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 shutdown_connections 2023-08-31T00:27:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:47.998+0000 7fe5a905f700 1 -- 172.21.15.77:0/3624439957 wait complete. 2023-08-31T00:27:48.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T00:26:57.431975+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T00:26:58.666350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:48.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:48.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 -- 172.21.15.77:0/486811248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 msgr2=0x7f2dec003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 --2- 172.21.15.77:0/486811248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2dec003e20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009be0 tx=0x7f2dec005880 comp rx=0 tx=0).stop 2023-08-31T00:27:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 -- 172.21.15.77:0/486811248 shutdown_connections 2023-08-31T00:27:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 --2- 172.21.15.77:0/486811248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2dec003e20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 -- 172.21.15.77:0/486811248 >> 172.21.15.77:0/486811248 conn(0x7f2e0406cbf0 msgr2=0x7f2e0406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 -- 172.21.15.77:0/486811248 shutdown_connections 2023-08-31T00:27:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.137+0000 7f2e09179700 1 -- 172.21.15.77:0/486811248 wait complete. 2023-08-31T00:27:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.139+0000 7f2e09179700 1 Processor -- start 2023-08-31T00:27:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.139+0000 7f2e09179700 1 -- start start 2023-08-31T00:27:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.139+0000 7f2e09179700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2e04159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.139+0000 7f2e09179700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e040ab280 0x7f2e04150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e09179700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e04152db0 0x7f2e04153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e09179700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040ac570 con 0x7f2dec003a00 2023-08-31T00:27:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e09179700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04153770 con 0x7f2e040ab280 2023-08-31T00:27:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e09179700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041544f0 con 0x7f2e04152db0 2023-08-31T00:27:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2e04159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2e04159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40254/0 (socket says 172.21.15.77:40254) 2023-08-31T00:27:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 -- 172.21.15.77:0/151047648 learned_addr learned my addr 172.21.15.77:0/151047648 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e0259c700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e040ab280 0x7f2e04150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e0359e700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e04152db0 0x7f2e04153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 -- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e04152db0 msgr2=0x7f2e04153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e04152db0 0x7f2e04153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 -- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e040ab280 msgr2=0x7f2e04150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e040ab280 0x7f2e04150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 -- 172.21.15.77:0/151047648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040ab9f0 con 0x7f2dec003a00 2023-08-31T00:27:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e0259c700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e040ab280 0x7f2e04150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e0359e700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e04152db0 0x7f2e04153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e02d9d700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2e04159520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2df8016000 tx=0x7f2df8005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003680 con 0x7f2dec003a00 2023-08-31T00:27:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2df80037e0 con 0x7f2dec003a00 2023-08-31T00:27:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003bf0 con 0x7f2dec003a00 2023-08-31T00:27:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e040abcd0 con 0x7f2dec003a00 2023-08-31T00:27:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.140+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e040ac290 con 0x7f2dec003a00 2023-08-31T00:27:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.141+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e041546b0 con 0x7f2dec003a00 2023-08-31T00:27:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.142+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2df8003d50 con 0x7f2dec003a00 2023-08-31T00:27:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.142+0000 7f2deb7fe700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2df006a0e0 0x7f2df006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.142+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2df8014070 con 0x7f2dec003a00 2023-08-31T00:27:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.142+0000 7f2e0259c700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2df006a0e0 0x7f2df006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.142+0000 7f2e0259c700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2df006a0e0 0x7f2df006c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2e0415b200 tx=0x7f2df4006c10 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.146+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2df8055b20 con 0x7f2dec003a00 2023-08-31T00:27:48.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.337+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e04073c30 con 0x7f2dec003a00 2023-08-31T00:27:48.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.337+0000 7f2deb7fe700 1 -- 172.21.15.77:0/151047648 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2df8059140 con 0x7f2dec003a00 2023-08-31T00:27:48.339 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.339+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2df006a0e0 msgr2=0x7f2df006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.339+0000 7f2e09179700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2df006a0e0 0x7f2df006c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2e0415b200 tx=0x7f2df4006c10 comp rx=0 tx=0).stop 2023-08-31T00:27:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.339+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 msgr2=0x7f2e04159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.339+0000 7f2e09179700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2e04159520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2df8016000 tx=0x7f2df8005e50 comp rx=0 tx=0).stop 2023-08-31T00:27:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 shutdown_connections 2023-08-31T00:27:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2df006a0e0 0x7f2df006c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2e04152db0 0x7f2e04153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dec003a00 0x7f2e04159520 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 --2- 172.21.15.77:0/151047648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e040ab280 0x7f2e04150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 >> 172.21.15.77:0/151047648 conn(0x7f2e0406cbf0 msgr2=0x7f2e04069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 shutdown_connections 2023-08-31T00:27:48.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.340+0000 7f2e09179700 1 -- 172.21.15.77:0/151047648 wait complete. 2023-08-31T00:27:48.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T00:27:48.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/268187507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00ce9c0 msgr2=0x7fa4c00d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/268187507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c00d0f70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009f60 tx=0x7fa4b8009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:48.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/268187507 shutdown_connections 2023-08-31T00:27:48.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/268187507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c00d0f70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/268187507 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4c015b3d0 0x7fa4c00cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/268187507 >> 172.21.15.77:0/268187507 conn(0x7fa4c0071630 msgr2=0x7fa4c0071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:48.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/268187507 shutdown_connections 2023-08-31T00:27:48.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.477+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/268187507 wait complete. 2023-08-31T00:27:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.478+0000 7fa4c4f3e700 1 Processor -- start 2023-08-31T00:27:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.478+0000 7fa4c4f3e700 1 -- start start 2023-08-31T00:27:48.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4c4f3e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 0x7fa4c01f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4c4f3e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c0146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4c4f3e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4c015b3d0 0x7fa4c0146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4c4f3e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00c5e60 con 0x7fa4c00b04a0 2023-08-31T00:27:48.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4c4f3e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00c6120 con 0x7fa4c00ce9c0 2023-08-31T00:27:48.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4c4f3e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00c6400 con 0x7fa4c015b3d0 2023-08-31T00:27:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 0x7fa4c01f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 0x7fa4c01f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40266/0 (socket says 172.21.15.77:40266) 2023-08-31T00:27:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 -- 172.21.15.77:0/3892418362 learned_addr learned my addr 172.21.15.77:0/3892418362 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 -- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4c015b3d0 msgr2=0x7fa4c0146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4c015b3d0 0x7fa4c0146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 -- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4c00ce9c0 msgr2=0x7fa4c0146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4bdd9b700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c0146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c0146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4be59c700 1 -- 172.21.15.77:0/3892418362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009c40 con 0x7fa4c00b04a0 2023-08-31T00:27:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.479+0000 7fa4bdd9b700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c0146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.480+0000 7fa4be59c700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 0x7fa4c01f54a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000b4a0 tx=0x7fa4b000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.480+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0011830 con 0x7fa4c00b04a0 2023-08-31T00:27:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.480+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa4b0011a80 con 0x7fa4c00b04a0 2023-08-31T00:27:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.480+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c00c66e0 con 0x7fa4c00b04a0 2023-08-31T00:27:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.480+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0011e90 con 0x7fa4c00b04a0 2023-08-31T00:27:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.480+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c01f59e0 con 0x7fa4c00b04a0 2023-08-31T00:27:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.481+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0073c30 con 0x7fa4c00b04a0 2023-08-31T00:27:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.481+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4b001a400 con 0x7fa4c00b04a0 2023-08-31T00:27:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.481+0000 7fa4aeffd700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa4a006a0e0 0x7fa4a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.482+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa4b0088760 con 0x7fa4c00b04a0 2023-08-31T00:27:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.482+0000 7fa4bdd9b700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa4a006a0e0 0x7fa4a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.482+0000 7fa4bdd9b700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa4a006a0e0 0x7fa4a006c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00c7e30 tx=0x7fa4b4009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.486+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4b0053ed0 con 0x7fa4c00b04a0 2023-08-31T00:27:48.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.675+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4c00cc970 con 0x7fa4c00b04a0 2023-08-31T00:27:48.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.675+0000 7fa4aeffd700 1 -- 172.21.15.77:0/3892418362 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4b00574f0 con 0x7fa4c00b04a0 2023-08-31T00:27:48.676 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-08-31T00:27:48.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa4a006a0e0 msgr2=0x7fa4a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa4a006a0e0 0x7fa4a006c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00c7e30 tx=0x7fa4b4009040 comp rx=0 tx=0).stop 2023-08-31T00:27:48.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 msgr2=0x7fa4c01f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 0x7fa4c01f54a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000b4a0 tx=0x7fa4b000b860 comp rx=0 tx=0).stop 2023-08-31T00:27:48.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 shutdown_connections 2023-08-31T00:27:48.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fa4a006a0e0 0x7fa4a006c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4c015b3d0 0x7fa4c0146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4c00b04a0 0x7fa4c01f54a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 --2- 172.21.15.77:0/3892418362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4c00ce9c0 0x7fa4c0146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 >> 172.21.15.77:0/3892418362 conn(0x7fa4c0071630 msgr2=0x7fa4c00b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:48.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 shutdown_connections 2023-08-31T00:27:48.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.677+0000 7fa4c4f3e700 1 -- 172.21.15.77:0/3892418362 wait complete. 2023-08-31T00:27:48.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T00:27:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.815+0000 7f94ac7b7700 1 -- 172.21.15.77:0/1484078582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 msgr2=0x7f94a40c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.815+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/1484078582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40c96b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94a4071d50 tx=0x7f949c00b330 comp rx=0 tx=0).stop 2023-08-31T00:27:48.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.815+0000 7f94ac7b7700 1 -- 172.21.15.77:0/1484078582 shutdown_connections 2023-08-31T00:27:48.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.815+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/1484078582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40c96b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.816+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/1484078582 >> v2:172.21.15.139:3300/0 conn(0x7f94a41580f0 0x7f94a40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.816+0000 7f94ac7b7700 1 -- 172.21.15.77:0/1484078582 >> 172.21.15.77:0/1484078582 conn(0x7f94a406cbf0 msgr2=0x7f94a406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:48.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.816+0000 7f94ac7b7700 1 -- 172.21.15.77:0/1484078582 shutdown_connections 2023-08-31T00:27:48.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.816+0000 7f94ac7b7700 1 -- 172.21.15.77:0/1484078582 wait complete. 2023-08-31T00:27:48.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 Processor -- start 2023-08-31T00:27:48.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 -- start start 2023-08-31T00:27:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94a406f130 0x7f94a41467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94a41580f0 0x7f94a40a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a41557f0 con 0x7f94a40711d0 2023-08-31T00:27:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4156370 con 0x7f94a406f130 2023-08-31T00:27:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.817+0000 7f94ac7b7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4143e60 con 0x7f94a41580f0 2023-08-31T00:27:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40a6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40280/0 (socket says 172.21.15.77:40280) 2023-08-31T00:27:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 -- 172.21.15.77:0/723339999 learned_addr learned my addr 172.21.15.77:0/723339999 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94aa553700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94a406f130 0x7f94a41467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 -- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94a41580f0 msgr2=0x7f94a40a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94a41580f0 0x7f94a40a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 -- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94a406f130 msgr2=0x7f94a41467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94a406f130 0x7f94a41467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 -- 172.21.15.77:0/723339999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009c40 con 0x7f94a40711d0 2023-08-31T00:27:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94aa553700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94a406f130 0x7f94a41467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94a9d52700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40a6460 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94a00011e0 tx=0x7f94a000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a00054e0 con 0x7f94a40711d0 2023-08-31T00:27:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94a0003680 con 0x7f94a40711d0 2023-08-31T00:27:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a4155a40 con 0x7f94a40711d0 2023-08-31T00:27:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0003a90 con 0x7f94a40711d0 2023-08-31T00:27:48.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.818+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a4156000 con 0x7f94a40711d0 2023-08-31T00:27:48.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.819+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a40731e0 con 0x7f94a40711d0 2023-08-31T00:27:48.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.819+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94a0003bf0 con 0x7f94a40711d0 2023-08-31T00:27:48.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.820+0000 7f949affd700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f948806a0e0 0x7f948806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:48.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.820+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f94a0087ac0 con 0x7f94a40711d0 2023-08-31T00:27:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.820+0000 7f94aa553700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f948806a0e0 0x7f948806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.820+0000 7f94aa553700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f948806a0e0 0x7f948806c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9494005950 tx=0x7f9494005d20 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:48.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:48.824+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f94a00532b0 con 0x7f94a40711d0 2023-08-31T00:27:49.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.011+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94a41564e0 con 0x7f94a40711d0 2023-08-31T00:27:49.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.011+0000 7f949affd700 1 -- 172.21.15.77:0/723339999 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94a0087e60 con 0x7f94a40711d0 2023-08-31T00:27:49.012 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-08-31T00:27:49.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f948806a0e0 msgr2=0x7f948806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f948806a0e0 0x7f948806c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9494005950 tx=0x7f9494005d20 comp rx=0 tx=0).stop 2023-08-31T00:27:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 msgr2=0x7f94a40a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40a6460 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94a00011e0 tx=0x7f94a000cae0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 shutdown_connections 2023-08-31T00:27:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f948806a0e0 0x7f948806c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94a41580f0 0x7f94a40a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94a406f130 0x7f94a41467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 --2- 172.21.15.77:0/723339999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94a40711d0 0x7f94a40a6460 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 >> 172.21.15.77:0/723339999 conn(0x7f94a406cbf0 msgr2=0x7f94a41536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 shutdown_connections 2023-08-31T00:27:49.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.013+0000 7f94ac7b7700 1 -- 172.21.15.77:0/723339999 wait complete. 2023-08-31T00:27:49.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:49.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 -- 172.21.15.77:0/477363849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f415b730 msgr2=0x7f22f415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 --2- 172.21.15.77:0/477363849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f415b730 0x7f22f415c8b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f22f00098c0 tx=0x7f22f0009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 -- 172.21.15.77:0/477363849 shutdown_connections 2023-08-31T00:27:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 --2- 172.21.15.77:0/477363849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f415b730 0x7f22f415c8b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 -- 172.21.15.77:0/477363849 >> 172.21.15.77:0/477363849 conn(0x7f22f4070270 msgr2=0x7f22f4070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 -- 172.21.15.77:0/477363849 shutdown_connections 2023-08-31T00:27:49.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.147+0000 7f22fb99e700 1 -- 172.21.15.77:0/477363849 wait complete. 2023-08-31T00:27:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.148+0000 7f22fb99e700 1 Processor -- start 2023-08-31T00:27:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.148+0000 7f22fb99e700 1 -- start start 2023-08-31T00:27:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22fb99e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f406b230 0x7f22f40ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22fb99e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 0x7f22f40cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22fb99e700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22f415b730 0x7f22f40c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22fb99e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c7550 con 0x7f22f4070d90 2023-08-31T00:27:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22fb99e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c6940 con 0x7f22f406b230 2023-08-31T00:27:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22fb99e700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f40c6c20 con 0x7f22f415b730 2023-08-31T00:27:49.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 0x7f22f40cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 0x7f22f40cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40294/0 (socket says 172.21.15.77:40294) 2023-08-31T00:27:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 -- 172.21.15.77:0/894846880 learned_addr learned my addr 172.21.15.77:0/894846880 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f973a700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f406b230 0x7f22f40ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 -- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22f415b730 msgr2=0x7f22f40c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22f415b730 0x7f22f40c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 -- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f406b230 msgr2=0x7f22f40ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f406b230 0x7f22f40ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f8f39700 1 -- 172.21.15.77:0/894846880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0009520 con 0x7f22f4070d90 2023-08-31T00:27:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.149+0000 7f22f973a700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f406b230 0x7f22f40ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.150+0000 7f22f8f39700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 0x7f22f40cb600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f22e4001eb0 tx=0x7f22e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:49.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.150+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e40054e0 con 0x7f22f4070d90 2023-08-31T00:27:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.150+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f22e4003680 con 0x7f22f4070d90 2023-08-31T00:27:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.150+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f40c6f00 con 0x7f22f4070d90 2023-08-31T00:27:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.150+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4003a50 con 0x7f22f4070d90 2023-08-31T00:27:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.150+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f40ab7c0 con 0x7f22f4070d90 2023-08-31T00:27:49.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.151+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f40c7700 con 0x7f22f4070d90 2023-08-31T00:27:49.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.151+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22e4003bb0 con 0x7f22f4070d90 2023-08-31T00:27:49.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.152+0000 7f22e9ffb700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f22d806a0e0 0x7f22d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.152+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f22e4087b40 con 0x7f22f4070d90 2023-08-31T00:27:49.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.152+0000 7f22f973a700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f22d806a0e0 0x7f22d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.152+0000 7f22f973a700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f22d806a0e0 0x7f22d806c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009230 tx=0x7f22f0019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:49.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.156+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f22f40c7700 con 0x7f22f4070d90 2023-08-31T00:27:49.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.387+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22f40c78e0 con 0x7f22f4070d90 2023-08-31T00:27:49.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.387+0000 7f22e9ffb700 1 -- 172.21.15.77:0/894846880 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f22e40532a0 con 0x7f22f4070d90 2023-08-31T00:27:49.389 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:49.389 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:49.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f22d806a0e0 msgr2=0x7f22d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f22d806a0e0 0x7f22d806c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009230 tx=0x7f22f0019040 comp rx=0 tx=0).stop 2023-08-31T00:27:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 msgr2=0x7f22f40cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 0x7f22f40cb600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f22e4001eb0 tx=0x7f22e400c8b0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 shutdown_connections 2023-08-31T00:27:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f22d806a0e0 0x7f22d806c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f22f415b730 0x7f22f40c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22f406b230 0x7f22f40ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 --2- 172.21.15.77:0/894846880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22f4070d90 0x7f22f40cb600 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 >> 172.21.15.77:0/894846880 conn(0x7f22f4070270 msgr2=0x7f22f40c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 shutdown_connections 2023-08-31T00:27:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.390+0000 7f22fb99e700 1 -- 172.21.15.77:0/894846880 wait complete. 2023-08-31T00:27:49.393 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:49.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 -- 172.21.15.77:0/3965975941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c15dc10 msgr2=0x7fcb3c0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3965975941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c15dc10 0x7fcb3c0c9d10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c071ba0 tx=0x7fcb28009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 -- 172.21.15.77:0/3965975941 shutdown_connections 2023-08-31T00:27:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3965975941 >> v2:172.21.15.139:3300/0 conn(0x7fcb3c159910 0x7fcb3c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3965975941 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb3c159530 0x7fcb3c0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3965975941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c15dc10 0x7fcb3c0c9d10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 -- 172.21.15.77:0/3965975941 >> 172.21.15.77:0/3965975941 conn(0x7fcb3c0cf180 msgr2=0x7fcb3c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:49.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 -- 172.21.15.77:0/3965975941 shutdown_connections 2023-08-31T00:27:49.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.524+0000 7fcb42e11700 1 -- 172.21.15.77:0/3965975941 wait complete. 2023-08-31T00:27:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.525+0000 7fcb42e11700 1 Processor -- start 2023-08-31T00:27:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.525+0000 7fcb42e11700 1 -- start start 2023-08-31T00:27:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb42e11700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 0x7fcb3c0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb42e11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb3c159910 0x7fcb3c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb42e11700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb3c15dc10 0x7fcb3c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb42e11700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c3e00 con 0x7fcb3c159530 2023-08-31T00:27:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb42e11700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c06c3c0 con 0x7fcb3c159910 2023-08-31T00:27:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb42e11700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c31f0 con 0x7fcb3c15dc10 2023-08-31T00:27:49.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 0x7fcb3c0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 0x7fcb3c0c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40306/0 (socket says 172.21.15.77:40306) 2023-08-31T00:27:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 -- 172.21.15.77:0/3066215456 learned_addr learned my addr 172.21.15.77:0/3066215456 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb3bfff700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb3c159910 0x7fcb3c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb413ae700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb3c15dc10 0x7fcb3c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 -- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb3c15dc10 msgr2=0x7fcb3c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb3c15dc10 0x7fcb3c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 -- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb3c159910 msgr2=0x7fcb3c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.526+0000 7fcb40bad700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb3c159910 0x7fcb3c157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb40bad700 1 -- 172.21.15.77:0/3066215456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb280095f0 con 0x7fcb3c159530 2023-08-31T00:27:49.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb40bad700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 0x7fcb3c0c4fc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000b530 tx=0x7fcb3000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30011830 con 0x7fcb3c159530 2023-08-31T00:27:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb30011a80 con 0x7fcb3c159530 2023-08-31T00:27:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c0c34d0 con 0x7fcb3c159530 2023-08-31T00:27:49.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30011e70 con 0x7fcb3c159530 2023-08-31T00:27:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.527+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c0c3a90 con 0x7fcb3c159530 2023-08-31T00:27:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.528+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c073c30 con 0x7fcb3c159530 2023-08-31T00:27:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.528+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcb3001a400 con 0x7fcb3c159530 2023-08-31T00:27:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.528+0000 7fcb397fa700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb2006a0e0 0x7fcb2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.529+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcb300887a0 con 0x7fcb3c159530 2023-08-31T00:27:49.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.529+0000 7fcb3bfff700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb2006a0e0 0x7fcb2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.529+0000 7fcb3bfff700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb2006a0e0 0x7fcb2006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c071ba0 tx=0x7fcb28019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:49.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.533+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcb30053ef0 con 0x7fcb3c159530 2023-08-31T00:27:49.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.726+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb3c0af740 con 0x7fcb3c159530 2023-08-31T00:27:49.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.727+0000 7fcb397fa700 1 -- 172.21.15.77:0/3066215456 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16743 (secure 0 0 0) 0x7fcb3001e1b0 con 0x7fcb3c159530 2023-08-31T00:27:49.728 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:49.728 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:41.588266+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:49.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb2006a0e0 msgr2=0x7fcb2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb2006a0e0 0x7fcb2006c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c071ba0 tx=0x7fcb28019040 comp rx=0 tx=0).stop 2023-08-31T00:27:49.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 msgr2=0x7fcb3c0c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 0x7fcb3c0c4fc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000b530 tx=0x7fcb3000b840 comp rx=0 tx=0).stop 2023-08-31T00:27:49.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 shutdown_connections 2023-08-31T00:27:49.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fcb2006a0e0 0x7fcb2006c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fcb3c15dc10 0x7fcb3c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcb3c159530 0x7fcb3c0c4fc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 --2- 172.21.15.77:0/3066215456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb3c159910 0x7fcb3c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 >> 172.21.15.77:0/3066215456 conn(0x7fcb3c0cf180 msgr2=0x7fcb3c153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 shutdown_connections 2023-08-31T00:27:49.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.729+0000 7fcb42e11700 1 -- 172.21.15.77:0/3066215456 wait complete. 2023-08-31T00:27:49.742 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T00:27:49.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:49.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2ba67a700 1 -- 172.21.15.77:0/3243057895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c003a30 msgr2=0x7fd29c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/3243057895 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd29c003a30 0x7fd29c003e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4001830 tx=0x7fd29c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:49.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2b8c17700 1 -- 172.21.15.77:0/3243057895 reap_dead start 2023-08-31T00:27:49.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2ba67a700 1 -- 172.21.15.77:0/3243057895 shutdown_connections 2023-08-31T00:27:49.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2ba67a700 1 -- 172.21.15.77:0/3243057895 >> 172.21.15.77:0/3243057895 conn(0x7fd2b4070270 msgr2=0x7fd2b4070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:49.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2ba67a700 1 -- 172.21.15.77:0/3243057895 shutdown_connections 2023-08-31T00:27:49.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.865+0000 7fd2ba67a700 1 -- 172.21.15.77:0/3243057895 wait complete. 2023-08-31T00:27:49.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.867+0000 7fd2ba67a700 1 Processor -- start 2023-08-31T00:27:49.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.867+0000 7fd2ba67a700 1 -- start start 2023-08-31T00:27:49.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2ba67a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd29c003a30 0x7fd2b41ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2ba67a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 0x7fd2b40c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2ba67a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2b40c2290 0x7fd2b40c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2ba67a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b41f1e80 con 0x7fd2b4158f80 2023-08-31T00:27:49.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2ba67a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b41eee90 con 0x7fd29c003a30 2023-08-31T00:27:49.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2ba67a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b41ef170 con 0x7fd2b40c2290 2023-08-31T00:27:49.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 0x7fd2b40c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 0x7fd2b40c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40326/0 (socket says 172.21.15.77:40326) 2023-08-31T00:27:49.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 -- 172.21.15.77:0/819920581 learned_addr learned my addr 172.21.15.77:0/819920581 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:49.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b3fff700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd29c003a30 0x7fd2b41ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b8c17700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2b40c2290 0x7fd2b40c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 -- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2b40c2290 msgr2=0x7fd2b40c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2b40c2290 0x7fd2b40c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 -- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd29c003a30 msgr2=0x7fd2b41ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:49.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd29c003a30 0x7fd2b41ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:49.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 -- 172.21.15.77:0/819920581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b41ef450 con 0x7fd2b4158f80 2023-08-31T00:27:49.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b3fff700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd29c003a30 0x7fd2b41ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:49.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.868+0000 7fd2b37fe700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 0x7fd2b40c6080 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800e7e0 tx=0x7fd2a800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:49.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.869+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8013070 con 0x7fd2b4158f80 2023-08-31T00:27:49.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.869+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd2a800a610 con 0x7fd2b4158f80 2023-08-31T00:27:49.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.869+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b41ef730 con 0x7fd2b4158f80 2023-08-31T00:27:49.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.869+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a800aa00 con 0x7fd2b4158f80 2023-08-31T00:27:49.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.869+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b40c65c0 con 0x7fd2b4158f80 2023-08-31T00:27:49.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.870+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b406eb00 con 0x7fd2b4158f80 2023-08-31T00:27:49.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.870+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd2a800ab60 con 0x7fd2b4158f80 2023-08-31T00:27:49.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.870+0000 7fd2b0ff9700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd2a006a0e0 0x7fd2a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:49.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.871+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd2a8089c90 con 0x7fd2b4158f80 2023-08-31T00:27:49.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.871+0000 7fd2b3fff700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd2a006a0e0 0x7fd2a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:49.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.871+0000 7fd2b3fff700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd2a006a0e0 0x7fd2a006c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4001830 tx=0x7fd2a400f000 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:49.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:49.875+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd2a8058e80 con 0x7fd2b4158f80 2023-08-31T00:27:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.107+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2b406c410 con 0x7fd2b4158f80 2023-08-31T00:27:50.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.108+0000 7fd2b0ff9700 1 -- 172.21.15.77:0/819920581 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7fd2a8058a10 con 0x7fd2b4158f80 2023-08-31T00:27:50.109 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:50.109 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd2a006a0e0 msgr2=0x7fd2a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd2a006a0e0 0x7fd2a006c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4001830 tx=0x7fd2a400f000 comp rx=0 tx=0).stop 2023-08-31T00:27:50.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 msgr2=0x7fd2b40c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 0x7fd2b40c6080 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800e7e0 tx=0x7fd2a800eba0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 shutdown_connections 2023-08-31T00:27:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd2a006a0e0 0x7fd2a006c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2b40c2290 0x7fd2b40c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd29c003a30 0x7fd2b41ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 --2- 172.21.15.77:0/819920581 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2b4158f80 0x7fd2b40c6080 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 >> 172.21.15.77:0/819920581 conn(0x7fd2b4070270 msgr2=0x7fd2b40c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 shutdown_connections 2023-08-31T00:27:50.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.110+0000 7fd2ba67a700 1 -- 172.21.15.77:0/819920581 wait complete. 2023-08-31T00:27:50.114 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:50.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:27:50.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 -- 172.21.15.77:0/1849322548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7980cc640 msgr2=0x7fd7980aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 --2- 172.21.15.77:0/1849322548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7980cc640 0x7fd7980aca00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd784005fd0 tx=0x7fd784009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 -- 172.21.15.77:0/1849322548 shutdown_connections 2023-08-31T00:27:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 --2- 172.21.15.77:0/1849322548 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 0x7fd79806af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 --2- 172.21.15.77:0/1849322548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7980cc640 0x7fd7980aca00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 -- 172.21.15.77:0/1849322548 >> 172.21.15.77:0/1849322548 conn(0x7fd798070270 msgr2=0x7fd798070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:50.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 -- 172.21.15.77:0/1849322548 shutdown_connections 2023-08-31T00:27:50.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.244+0000 7fd79ef17700 1 -- 172.21.15.77:0/1849322548 wait complete. 2023-08-31T00:27:50.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.245+0000 7fd79ef17700 1 Processor -- start 2023-08-31T00:27:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.245+0000 7fd79ef17700 1 -- start start 2023-08-31T00:27:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79ef17700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 0x7fd7980c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79ef17700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7980cc640 0x7fd79806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79ef17700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 0x7fd7980c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79ef17700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980c6160 con 0x7fd79815bb70 2023-08-31T00:27:50.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79ef17700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980c46a0 con 0x7fd7980cc640 2023-08-31T00:27:50.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79ef17700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7980c8510 con 0x7fd79806ab20 2023-08-31T00:27:50.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79d4b4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 0x7fd7980c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79d4b4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 0x7fd7980c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40344/0 (socket says 172.21.15.77:40344) 2023-08-31T00:27:50.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.246+0000 7fd79d4b4700 1 -- 172.21.15.77:0/2604616682 learned_addr learned my addr 172.21.15.77:0/2604616682 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:50.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd797fff700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7980cc640 0x7fd79806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79d4b4700 1 -- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 msgr2=0x7fd7980c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79ccb3700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 0x7fd7980c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79d4b4700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 0x7fd7980c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79d4b4700 1 -- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7980cc640 msgr2=0x7fd79806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79d4b4700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7980cc640 0x7fd79806d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79d4b4700 1 -- 172.21.15.77:0/2604616682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840095f0 con 0x7fd79815bb70 2023-08-31T00:27:50.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd797fff700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7980cc640 0x7fd79806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:50.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79ccb3700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 0x7fd7980c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:50.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79d4b4700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 0x7fd7980c68d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd79000b9e0 tx=0x7fd79000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:50.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79000c9b0 con 0x7fd79815bb70 2023-08-31T00:27:50.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd79000cc00 con 0x7fd79815bb70 2023-08-31T00:27:50.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790014440 con 0x7fd79815bb70 2023-08-31T00:27:50.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7980c87f0 con 0x7fd79815bb70 2023-08-31T00:27:50.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.247+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7980c63b0 con 0x7fd79815bb70 2023-08-31T00:27:50.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.248+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7980c65a0 con 0x7fd79815bb70 2023-08-31T00:27:50.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.249+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd790006d50 con 0x7fd79815bb70 2023-08-31T00:27:50.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.249+0000 7fd7957fa700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77c06a0e0 0x7fd77c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.249+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd790088130 con 0x7fd79815bb70 2023-08-31T00:27:50.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.249+0000 7fd79ccb3700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77c06a0e0 0x7fd77c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.249+0000 7fd79ccb3700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77c06a0e0 0x7fd77c06c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd78c007900 tx=0x7fd78c008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:50.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.253+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd790053890 con 0x7fd79815bb70 2023-08-31T00:27:50.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.487+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd798073c30 con 0x7fd79815bb70 2023-08-31T00:27:50.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.487+0000 7fd7957fa700 1 -- 172.21.15.77:0/2604616682 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7fd790056eb0 con 0x7fd79815bb70 2023-08-31T00:27:50.489 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:50.489 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4304,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/2497919607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":2497919607},{"type":"v1","addr":"172.21.15.139:6835","nonce":2497919607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/2790916934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2790916934},{"type":"v1","addr":"172.21.15.139:6834","nonce":2790916934}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4371,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/1597657875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1597657875},{"type":"v1","addr":"172.21.15.77:6836","nonce":1597657875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:26:59.699290+0000","modified":"2023-08-31T00:27:03.326289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/2023855175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":2023855175},{"type":"v1","addr":"172.21.15.77:6837","nonce":2023855175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T00:27:50.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.489+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77c06a0e0 msgr2=0x7fd77c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.489+0000 7fd79ef17700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77c06a0e0 0x7fd77c06c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd78c007900 tx=0x7fd78c008040 comp rx=0 tx=0).stop 2023-08-31T00:27:50.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.489+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 msgr2=0x7fd7980c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.489+0000 7fd79ef17700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 0x7fd7980c68d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd79000b9e0 tx=0x7fd79000bda0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.489+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 shutdown_connections 2023-08-31T00:27:50.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.489+0000 7fd79ef17700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd77c06a0e0 0x7fd77c06c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.490+0000 7fd79ef17700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd79806ab20 0x7fd7980c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.490+0000 7fd79ef17700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79815bb70 0x7fd7980c68d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.490+0000 7fd79ef17700 1 --2- 172.21.15.77:0/2604616682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7980cc640 0x7fd79806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.490+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 >> 172.21.15.77:0/2604616682 conn(0x7fd798070270 msgr2=0x7fd798158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:50.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.490+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 shutdown_connections 2023-08-31T00:27:50.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.490+0000 7fd79ef17700 1 -- 172.21.15.77:0/2604616682 wait complete. 2023-08-31T00:27:50.494 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2023-08-31T00:27:50.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:50.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 -- 172.21.15.77:0/4174703864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f358015b380 msgr2=0x7f35800cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 --2- 172.21.15.77:0/4174703864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f358015b380 0x7f35800cc010 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f35800cb910 tx=0x7f3574009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 -- 172.21.15.77:0/4174703864 shutdown_connections 2023-08-31T00:27:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 --2- 172.21.15.77:0/4174703864 >> v2:172.21.15.139:3300/0 conn(0x7f35800cc550 0x7f35800b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 --2- 172.21.15.77:0/4174703864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f358015b380 0x7f35800cc010 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 -- 172.21.15.77:0/4174703864 >> 172.21.15.77:0/4174703864 conn(0x7f3580071630 msgr2=0x7f3580071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 -- 172.21.15.77:0/4174703864 shutdown_connections 2023-08-31T00:27:50.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.628+0000 7f3585966700 1 -- 172.21.15.77:0/4174703864 wait complete. 2023-08-31T00:27:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.629+0000 7f3585966700 1 Processor -- start 2023-08-31T00:27:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.629+0000 7f3585966700 1 -- start start 2023-08-31T00:27:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f3585966700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 0x7f35801f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f3585966700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35800cc550 0x7f35800cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f3585966700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f358015b380 0x7f35801f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f3585966700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3580151590 con 0x7f35800b6fc0 2023-08-31T00:27:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f3585966700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35801f2f00 con 0x7f358015b380 2023-08-31T00:27:50.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f3585966700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35801f2700 con 0x7f35800cc550 2023-08-31T00:27:50.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f357effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 0x7f35801f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f357effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 0x7f35801f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40354/0 (socket says 172.21.15.77:40354) 2023-08-31T00:27:50.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f357effd700 1 -- 172.21.15.77:0/2489591347 learned_addr learned my addr 172.21.15.77:0/2489591347 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:50.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f357f7fe700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f358015b380 0x7f35801f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.630+0000 7f357e7fc700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35800cc550 0x7f35800cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357effd700 1 -- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35800cc550 msgr2=0x7f35800cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357effd700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35800cc550 0x7f35800cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357effd700 1 -- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f358015b380 msgr2=0x7f35801f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357effd700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f358015b380 0x7f35801f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357effd700 1 -- 172.21.15.77:0/2489591347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35740095f0 con 0x7f35800b6fc0 2023-08-31T00:27:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357f7fe700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f358015b380 0x7f35801f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.631+0000 7f357effd700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 0x7f35801f3160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f35800d2440 tx=0x7f35740050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.632+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357401c070 con 0x7f35800b6fc0 2023-08-31T00:27:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.632+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3574004260 con 0x7f35800b6fc0 2023-08-31T00:27:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.632+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3580150f30 con 0x7f35800b6fc0 2023-08-31T00:27:50.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.632+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400b760 con 0x7f35800b6fc0 2023-08-31T00:27:50.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.632+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35801f2c20 con 0x7f35800b6fc0 2023-08-31T00:27:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.633+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3580067e50 con 0x7f35800b6fc0 2023-08-31T00:27:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.633+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f357400b8c0 con 0x7f35800b6fc0 2023-08-31T00:27:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.634+0000 7f3567fff700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f356c06a0e0 0x7f356c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.634+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3574089940 con 0x7f35800b6fc0 2023-08-31T00:27:50.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.634+0000 7f357e7fc700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f356c06a0e0 0x7f356c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.634+0000 7f357e7fc700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f356c06a0e0 0x7f356c06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35800cabe0 tx=0x7f3570009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:50.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.638+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3574055130 con 0x7f35800b6fc0 2023-08-31T00:27:50.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.829+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3580071f40 con 0x7f35800b6fc0 2023-08-31T00:27:50.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.830+0000 7f3567fff700 1 -- 172.21.15.77:0/2489591347 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16743 (secure 0 0 0) 0x7f3574058750 con 0x7f35800b6fc0 2023-08-31T00:27:50.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:50.831 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:41.588266+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:26:57.431975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T00:26:58.666350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:50.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f356c06a0e0 msgr2=0x7f356c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f356c06a0e0 0x7f356c06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35800cabe0 tx=0x7f3570009040 comp rx=0 tx=0).stop 2023-08-31T00:27:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 msgr2=0x7f35801f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 0x7f35801f3160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f35800d2440 tx=0x7f35740050d0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 shutdown_connections 2023-08-31T00:27:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f356c06a0e0 0x7f356c06c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f358015b380 0x7f35801f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35800b6fc0 0x7f35801f3160 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 --2- 172.21.15.77:0/2489591347 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f35800cc550 0x7f35800cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 >> 172.21.15.77:0/2489591347 conn(0x7f3580071630 msgr2=0x7f358015a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:50.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 shutdown_connections 2023-08-31T00:27:50.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.832+0000 7f3585966700 1 -- 172.21.15.77:0/2489591347 wait complete. 2023-08-31T00:27:50.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T00:27:50.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 -- 172.21.15.77:0/2801184990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 msgr2=0x7f94d815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 --2- 172.21.15.77:0/2801184990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d815c8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0098c0 tx=0x7f94cc009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 -- 172.21.15.77:0/2801184990 shutdown_connections 2023-08-31T00:27:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 --2- 172.21.15.77:0/2801184990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d815c8b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 -- 172.21.15.77:0/2801184990 >> 172.21.15.77:0/2801184990 conn(0x7f94d8070270 msgr2=0x7f94d8070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 -- 172.21.15.77:0/2801184990 shutdown_connections 2023-08-31T00:27:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.968+0000 7f94dcba4700 1 -- 172.21.15.77:0/2801184990 wait complete. 2023-08-31T00:27:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.969+0000 7f94dcba4700 1 Processor -- start 2023-08-31T00:27:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.969+0000 7f94dcba4700 1 -- start start 2023-08-31T00:27:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94dcba4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d806b230 0x7f94d8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94dcba4700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d8070d90 0x7f94d80cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94dcba4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d80a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94dcba4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d81554a0 con 0x7f94d815b730 2023-08-31T00:27:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94dcba4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c37f0 con 0x7f94d806b230 2023-08-31T00:27:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94dcba4700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80c3ad0 con 0x7f94d8070d90 2023-08-31T00:27:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d80a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d80a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40372/0 (socket says 172.21.15.77:40372) 2023-08-31T00:27:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 -- 172.21.15.77:0/3500451961 learned_addr learned my addr 172.21.15.77:0/3500451961 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d659c700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d806b230 0x7f94d8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d5d9b700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d8070d90 0x7f94d80cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 -- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d8070d90 msgr2=0x7f94d80cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d8070d90 0x7f94d80cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 -- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d806b230 msgr2=0x7f94d8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d806b230 0x7f94d8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 -- 172.21.15.77:0/3500451961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc009520 con 0x7f94d815b730 2023-08-31T00:27:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.970+0000 7f94d6d9d700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d80a6bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f94d000cb60 tx=0x7f94d000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.971+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000ab10 con 0x7f94d815b730 2023-08-31T00:27:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.971+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94d000ad60 con 0x7f94d815b730 2023-08-31T00:27:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.971+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80c3db0 con 0x7f94d815b730 2023-08-31T00:27:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.971+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0012680 con 0x7f94d815b730 2023-08-31T00:27:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.971+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d80c4370 con 0x7f94d815b730 2023-08-31T00:27:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.972+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d8073c30 con 0x7f94d815b730 2023-08-31T00:27:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.972+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94d00127e0 con 0x7f94d815b730 2023-08-31T00:27:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.972+0000 7f94c6ffd700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f94b806a0e0 0x7f94b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:50.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.973+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f94d00889d0 con 0x7f94d815b730 2023-08-31T00:27:50.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.973+0000 7f94d659c700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f94b806a0e0 0x7f94b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:50.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.973+0000 7f94d659c700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f94b806a0e0 0x7f94b806c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc011040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:50.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:50.977+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f94d00541c0 con 0x7f94d815b730 2023-08-31T00:27:51.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.211+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f94d8065c80 con 0x7f94d815b730 2023-08-31T00:27:51.213 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-08-31T00:27:51.212+0000 7f27e8fad700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T00:27:51.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.216+0000 7f94c6ffd700 1 -- 172.21.15.77:0/3500451961 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f94d00577e0 con 0x7f94d815b730 2023-08-31T00:27:51.218 INFO:tasks.ceph.mds.a.smithi077.stderr: -2926> 2023-08-31T00:27:02.690+0000 7facb3074700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T00:27:51.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.218+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f94b806a0e0 msgr2=0x7f94b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.218+0000 7f94dcba4700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f94b806a0e0 0x7f94b806c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc011040 comp rx=0 tx=0).stop 2023-08-31T00:27:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.218+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 msgr2=0x7f94d80a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.218+0000 7f94dcba4700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d80a6bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f94d000cb60 tx=0x7f94d000cf20 comp rx=0 tx=0).stop 2023-08-31T00:27:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 shutdown_connections 2023-08-31T00:27:51.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f94b806a0e0 0x7f94b806c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94d815b730 0x7f94d80a6bc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d806b230 0x7f94d8154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 --2- 172.21.15.77:0/3500451961 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d8070d90 0x7f94d80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 >> 172.21.15.77:0/3500451961 conn(0x7f94d8070270 msgr2=0x7f94d806d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:51.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 shutdown_connections 2023-08-31T00:27:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.219+0000 7f94dcba4700 1 -- 172.21.15.77:0/3500451961 wait complete. 2023-08-31T00:27:51.222 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T00:27:51.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T00:27:51.246 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-08-31T00:27:51.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.355+0000 7f3191ba0700 1 -- 172.21.15.77:0/1063227504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0b0b20 msgr2=0x7f318c0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:51.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.355+0000 7f3191ba0700 1 --2- 172.21.15.77:0/1063227504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0b0b20 0x7f318c0cc350 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3184009f90 tx=0x7f318400b330 comp rx=0 tx=0).stop 2023-08-31T00:27:51.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.355+0000 7f3191ba0700 1 -- 172.21.15.77:0/1063227504 shutdown_connections 2023-08-31T00:27:51.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.355+0000 7f3191ba0700 1 --2- 172.21.15.77:0/1063227504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0b0b20 0x7f318c0cc350 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.355+0000 7f3191ba0700 1 --2- 172.21.15.77:0/1063227504 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f318c0ace10 0x7f318c06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.355+0000 7f3191ba0700 1 -- 172.21.15.77:0/1063227504 >> 172.21.15.77:0/1063227504 conn(0x7f318c070270 msgr2=0x7f318c070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:51.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.356+0000 7f3191ba0700 1 -- 172.21.15.77:0/1063227504 shutdown_connections 2023-08-31T00:27:51.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.356+0000 7f3191ba0700 1 -- 172.21.15.77:0/1063227504 wait complete. 2023-08-31T00:27:51.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.357+0000 7f3191ba0700 1 Processor -- start 2023-08-31T00:27:51.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.357+0000 7f3191ba0700 1 -- start start 2023-08-31T00:27:51.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f318c0ace10 0x7f318c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:51.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f318c0b06a0 0x7f318c0c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:51.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 0x7f318c0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:51.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0c7a40 con 0x7f318c0c1560 2023-08-31T00:27:51.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c153a60 con 0x7f318c0b06a0 2023-08-31T00:27:51.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0c7480 con 0x7f318c0ace10 2023-08-31T00:27:51.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 0x7f318c0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:51.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 0x7f318c0c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40398/0 (socket says 172.21.15.77:40398) 2023-08-31T00:27:51.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 -- 172.21.15.77:0/3410149874 learned_addr learned my addr 172.21.15.77:0/3410149874 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:51.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318b7fe700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f318c0ace10 0x7f318c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:51.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318affd700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f318c0b06a0 0x7f318c0c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:51.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 -- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f318c0ace10 msgr2=0x7f318c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:51.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f318c0ace10 0x7f318c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 -- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f318c0b06a0 msgr2=0x7f318c0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:51.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f318c0b06a0 0x7f318c0c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:51.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 -- 172.21.15.77:0/3410149874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009c40 con 0x7f318c0c1560 2023-08-31T00:27:51.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f318bfff700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 0x7f318c0c3f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f318c06fac0 tx=0x7f3184007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:51.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184021070 con 0x7f318c0c1560 2023-08-31T00:27:51.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3184009ac0 con 0x7f318c0c1560 2023-08-31T00:27:51.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c0c7760 con 0x7f318c0c1560 2023-08-31T00:27:51.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318400e040 con 0x7f318c0c1560 2023-08-31T00:27:51.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.358+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c1540e0 con 0x7f318c0c1560 2023-08-31T00:27:51.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.359+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c153c60 con 0x7f318c0c1560 2023-08-31T00:27:51.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.360+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3184012600 con 0x7f318c0c1560 2023-08-31T00:27:51.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.360+0000 7f3173fff700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f317806a0e0 0x7f317806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:51.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.360+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f31840895c0 con 0x7f318c0c1560 2023-08-31T00:27:51.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.360+0000 7f318b7fe700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f317806a0e0 0x7f317806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:51.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.361+0000 7f318b7fe700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f317806a0e0 0x7f317806c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f317c00ba60 tx=0x7f317c005d50 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:51.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.364+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f318c153c60 con 0x7f318c0c1560 2023-08-31T00:27:51.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:51.598+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f318c153c60 con 0x7f318c0c1560 2023-08-31T00:27:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.217+0000 7f3173fff700 1 -- 172.21.15.77:0/3410149874 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f318c153c60 con 0x7f318c0c1560 2023-08-31T00:27:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f317806a0e0 msgr2=0x7f317806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f317806a0e0 0x7f317806c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f317c00ba60 tx=0x7f317c005d50 comp rx=0 tx=0).stop 2023-08-31T00:27:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 msgr2=0x7f318c0c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 0x7f318c0c3f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f318c06fac0 tx=0x7f3184007bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 shutdown_connections 2023-08-31T00:27:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f317806a0e0 0x7f317806c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f318c0ace10 0x7f318c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f318c0c1560 0x7f318c0c3f50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 --2- 172.21.15.77:0/3410149874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f318c0b06a0 0x7f318c0c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 >> 172.21.15.77:0/3410149874 conn(0x7f318c070270 msgr2=0x7f318c06aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 shutdown_connections 2023-08-31T00:27:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.221+0000 7f3191ba0700 1 -- 172.21.15.77:0/3410149874 wait complete. 2023-08-31T00:27:52.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T00:27:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94ec10700 1 -- 172.21.15.77:0/17159753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd938004030 msgr2=0x7fd938004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94ec10700 1 --2- 172.21.15.77:0/17159753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd938004030 0x7fd938004850 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd93400bb90 tx=0x7fd938005880 comp rx=0 tx=0).stop 2023-08-31T00:27:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94d1ad700 1 -- 172.21.15.77:0/17159753 reap_dead start 2023-08-31T00:27:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94ec10700 1 -- 172.21.15.77:0/17159753 shutdown_connections 2023-08-31T00:27:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94ec10700 1 -- 172.21.15.77:0/17159753 >> 172.21.15.77:0/17159753 conn(0x7fd9480afb80 msgr2=0x7fd9480aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94ec10700 1 -- 172.21.15.77:0/17159753 shutdown_connections 2023-08-31T00:27:52.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.409+0000 7fd94ec10700 1 -- 172.21.15.77:0/17159753 wait complete. 2023-08-31T00:27:52.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.410+0000 7fd94ec10700 1 Processor -- start 2023-08-31T00:27:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.410+0000 7fd94ec10700 1 -- start start 2023-08-31T00:27:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd94ec10700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd938004030 0x7fd9480c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd94ec10700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 0x7fd9481eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd94ec10700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd94806a1e0 0x7fd9481ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:52.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd94ec10700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c27f0 con 0x7fd948069d80 2023-08-31T00:27:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd94ec10700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c2ad0 con 0x7fd938004030 2023-08-31T00:27:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd94ec10700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c2db0 con 0x7fd94806a1e0 2023-08-31T00:27:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd947fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 0x7fd9481eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd947fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 0x7fd9481eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40418/0 (socket says 172.21.15.77:40418) 2023-08-31T00:27:52.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.411+0000 7fd947fff700 1 -- 172.21.15.77:0/2540777128 learned_addr learned my addr 172.21.15.77:0/2540777128 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd94c9ac700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd938004030 0x7fd9480c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd94d1ad700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd94806a1e0 0x7fd9481ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd947fff700 1 -- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd94806a1e0 msgr2=0x7fd9481ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd947fff700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd94806a1e0 0x7fd9481ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd947fff700 1 -- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd938004030 msgr2=0x7fd9480c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:52.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd947fff700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd938004030 0x7fd9480c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:52.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd947fff700 1 -- 172.21.15.77:0/2540777128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480c3090 con 0x7fd948069d80 2023-08-31T00:27:52.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd94c9ac700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd938004030 0x7fd9480c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:52.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd947fff700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 0x7fd9481eee50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd93400bae0 tx=0x7fd93400b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934004460 con 0x7fd948069d80 2023-08-31T00:27:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd934003680 con 0x7fd948069d80 2023-08-31T00:27:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480c3370 con 0x7fd948069d80 2023-08-31T00:27:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd934003a90 con 0x7fd948069d80 2023-08-31T00:27:52.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.412+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9480c1ce0 con 0x7fd948069d80 2023-08-31T00:27:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.413+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9480c8280 con 0x7fd948069d80 2023-08-31T00:27:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.413+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd934003bf0 con 0x7fd948069d80 2023-08-31T00:27:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.414+0000 7fd9457fa700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd92c06a0e0 0x7fd92c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.414+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fd934089ee0 con 0x7fd948069d80 2023-08-31T00:27:52.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.414+0000 7fd94c9ac700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd92c06a0e0 0x7fd92c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:52.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.414+0000 7fd94c9ac700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd92c06a0e0 0x7fd92c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd93c005fd0 tx=0x7fd93c00b2e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:52.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.418+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd934055680 con 0x7fd948069d80 2023-08-31T00:27:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:52.610+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9480c3590 con 0x7fd948069d80 2023-08-31T00:27:53.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.218+0000 7fd9457fa700 1 -- 172.21.15.77:0/2540777128 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd934016020 con 0x7fd948069d80 2023-08-31T00:27:53.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.222+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd92c06a0e0 msgr2=0x7fd92c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:53.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.222+0000 7fd94ec10700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd92c06a0e0 0x7fd92c06c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd93c005fd0 tx=0x7fd93c00b2e0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.222+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 msgr2=0x7fd9481eee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:53.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.222+0000 7fd94ec10700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 0x7fd9481eee50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd93400bae0 tx=0x7fd93400b5d0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 shutdown_connections 2023-08-31T00:27:53.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd92c06a0e0 0x7fd92c06c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd94806a1e0 0x7fd9481ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd938004030 0x7fd9480c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 --2- 172.21.15.77:0/2540777128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd948069d80 0x7fd9481eee50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 >> 172.21.15.77:0/2540777128 conn(0x7fd9480afb80 msgr2=0x7fd94815a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 shutdown_connections 2023-08-31T00:27:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.223+0000 7fd94ec10700 1 -- 172.21.15.77:0/2540777128 wait complete. 2023-08-31T00:27:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-08-31T00:27:53.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T00:27:53.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d1704f700 1 -- 172.21.15.77:0/173504304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d00004d90 msgr2=0x7f2d00005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:53.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d1704f700 1 --2- 172.21.15.77:0/173504304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d00004d90 0x7f2d00005210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800c640 tx=0x7f2d00005880 comp rx=0 tx=0).stop 2023-08-31T00:27:53.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d155ec700 1 -- 172.21.15.77:0/173504304 reap_dead start 2023-08-31T00:27:53.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d1704f700 1 -- 172.21.15.77:0/173504304 shutdown_connections 2023-08-31T00:27:53.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d1704f700 1 -- 172.21.15.77:0/173504304 >> 172.21.15.77:0/173504304 conn(0x7f2d10069b10 msgr2=0x7f2d10069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:53.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d1704f700 1 -- 172.21.15.77:0/173504304 shutdown_connections 2023-08-31T00:27:53.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.368+0000 7f2d1704f700 1 -- 172.21.15.77:0/173504304 wait complete. 2023-08-31T00:27:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.369+0000 7f2d1704f700 1 Processor -- start 2023-08-31T00:27:53.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.369+0000 7f2d1704f700 1 -- start start 2023-08-31T00:27:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d100adf60 0x7f2d100a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 0x7f2d101efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d100c78e0 0x7f2d100c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100c82d0 con 0x7f2d101ef840 2023-08-31T00:27:53.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100b0570 con 0x7f2d100c78e0 2023-08-31T00:27:53.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100af960 con 0x7f2d100adf60 2023-08-31T00:27:53.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 0x7f2d101efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:53.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 0x7f2d101efcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40438/0 (socket says 172.21.15.77:40438) 2023-08-31T00:27:53.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 -- 172.21.15.77:0/3705906301 learned_addr learned my addr 172.21.15.77:0/3705906301 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:53.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d14deb700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d100adf60 0x7f2d100a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:53.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d155ec700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d100c78e0 0x7f2d100c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:53.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 -- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d100adf60 msgr2=0x7f2d100a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:53.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d100adf60 0x7f2d100a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 -- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d100c78e0 msgr2=0x7f2d100c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:53.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d100c78e0 0x7f2d100c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 -- 172.21.15.77:0/3705906301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100afc40 con 0x7f2d101ef840 2023-08-31T00:27:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0ffff700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 0x7f2d101efcc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc001260 tx=0x7f2cfc001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc006230 con 0x7f2d101ef840 2023-08-31T00:27:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2cfc011630 con 0x7f2d101ef840 2023-08-31T00:27:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d100aff20 con 0x7f2d101ef840 2023-08-31T00:27:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.370+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0119c0 con 0x7f2d101ef840 2023-08-31T00:27:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.371+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d100ae340 con 0x7f2d101ef840 2023-08-31T00:27:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.371+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d100b06b0 con 0x7f2d101ef840 2023-08-31T00:27:53.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.372+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2cfc011b20 con 0x7f2d101ef840 2023-08-31T00:27:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.372+0000 7f2d0d7fa700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2cf406a0e0 0x7f2cf406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.372+0000 7f2d14deb700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2cf406a0e0 0x7f2cf406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:53.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.373+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f2cfc088fe0 con 0x7f2d101ef840 2023-08-31T00:27:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.373+0000 7f2d14deb700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2cf406a0e0 0x7f2cf406c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d100b3270 tx=0x7f2d04009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:53.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.377+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2cfc0548a0 con 0x7f2d101ef840 2023-08-31T00:27:53.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:53.569+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d100c9d90 con 0x7f2d101ef840 2023-08-31T00:27:54.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.287+0000 7f2d0d7fa700 1 -- 172.21.15.77:0/3705906301 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2cfc01f0d0 con 0x7f2d101ef840 2023-08-31T00:27:54.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2cf406a0e0 msgr2=0x7f2cf406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2cf406a0e0 0x7f2cf406c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d100b3270 tx=0x7f2d04009260 comp rx=0 tx=0).stop 2023-08-31T00:27:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 msgr2=0x7f2d101efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 0x7f2d101efcc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc001260 tx=0x7f2cfc001570 comp rx=0 tx=0).stop 2023-08-31T00:27:54.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 shutdown_connections 2023-08-31T00:27:54.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f2cf406a0e0 0x7f2cf406c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:54.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2d100adf60 0x7f2d100a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:54.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d100c78e0 0x7f2d100c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:54.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 --2- 172.21.15.77:0/3705906301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d101ef840 0x7f2d101efcc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 >> 172.21.15.77:0/3705906301 conn(0x7f2d10069b10 msgr2=0x7f2d100c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 shutdown_connections 2023-08-31T00:27:54.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.292+0000 7f2d1704f700 1 -- 172.21.15.77:0/3705906301 wait complete. 2023-08-31T00:27:54.298 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-08-31T00:27:54.311 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T00:27:54.312 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T00:27:54.312 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T00:27:54.313 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:54.313 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T00:27:54.314 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T00:27:54.314 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T00:27:54.314 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:54.315 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T00:27:54.315 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T00:27:54.315 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T00:27:54.316 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:54.316 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T00:27:54.316 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T00:27:54.316 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T00:27:54.317 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T00:27:54.324 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T00:27:54.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T00:27:54.326 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T00:27:54.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T00:27:54.327 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T00:27:54.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T00:27:54.329 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T00:27:54.329 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T00:27:54.367 INFO:tasks.ceph.mds.a:Started 2023-08-31T00:27:54.367 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:54.368 INFO:tasks.ceph.mds.c:Started 2023-08-31T00:27:54.368 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:54.371 INFO:tasks.ceph.mds.b:Started 2023-08-31T00:27:54.371 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:54.372 INFO:tasks.ceph.mds.d:Started 2023-08-31T00:27:54.372 DEBUG:teuthology.parallel:result is None 2023-08-31T00:27:54.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T00:27:54.450 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-08-31T00:27:54.451 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-08-31T00:27:54.460 INFO:tasks.ceph.mds.d.smithi139.stdout:starting mds.d at 2023-08-31T00:27:54.460 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2023-08-31T00:27:54.461 INFO:tasks.ceph.mds.b.smithi139.stderr:2023-08-31T00:27:54.460+0000 7f4344714700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-08-31T00:27:54.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2f3de700 1 -- 172.21.15.77:0/3495090215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10005090 msgr2=0x7f8e1000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:54.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/3495090215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e10005090 0x7f8e1000ba10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8e280c9eb0 tx=0x7f8e10005880 comp rx=0 tx=0).stop 2023-08-31T00:27:54.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2d97b700 1 -- 172.21.15.77:0/3495090215 reap_dead start 2023-08-31T00:27:54.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2f3de700 1 -- 172.21.15.77:0/3495090215 shutdown_connections 2023-08-31T00:27:54.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2f3de700 1 -- 172.21.15.77:0/3495090215 >> 172.21.15.77:0/3495090215 conn(0x7f8e280afbf0 msgr2=0x7f8e280b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:54.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2f3de700 1 -- 172.21.15.77:0/3495090215 shutdown_connections 2023-08-31T00:27:54.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.506+0000 7f8e2f3de700 1 -- 172.21.15.77:0/3495090215 wait complete. 2023-08-31T00:27:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.507+0000 7f8e2f3de700 1 Processor -- start 2023-08-31T00:27:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.507+0000 7f8e2f3de700 1 -- start start 2023-08-31T00:27:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2f3de700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8e10005090 0x7f8e28149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:54.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2f3de700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e280cd8e0 0x7f8e280c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2f3de700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 0x7f8e280c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2f3de700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281499b0 con 0x7f8e280c50f0 2023-08-31T00:27:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2f3de700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280c32c0 con 0x7f8e280cd8e0 2023-08-31T00:27:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2f3de700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280c3590 con 0x7f8e10005090 2023-08-31T00:27:54.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 0x7f8e280c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 0x7f8e280c5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40482/0 (socket says 172.21.15.77:40482) 2023-08-31T00:27:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 -- 172.21.15.77:0/2063603746 learned_addr learned my addr 172.21.15.77:0/2063603746 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2c979700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e280cd8e0 0x7f8e280c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d17a700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8e10005090 0x7f8e28149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:54.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 -- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8e10005090 msgr2=0x7f8e28149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8e10005090 0x7f8e28149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 -- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e280cd8e0 msgr2=0x7f8e280c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e280cd8e0 0x7f8e280c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 -- 172.21.15.77:0/2063603746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280c3870 con 0x7f8e280c50f0 2023-08-31T00:27:54.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2c979700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e280cd8e0 0x7f8e280c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:54.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.508+0000 7f8e2d97b700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 0x7f8e280c5570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000bf80 tx=0x7f8e18013990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:54.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.509+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18022070 con 0x7f8e280c50f0 2023-08-31T00:27:54.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.509+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e18018040 con 0x7f8e280c50f0 2023-08-31T00:27:54.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.509+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e280c3b50 con 0x7f8e280c50f0 2023-08-31T00:27:54.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.509+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18017050 con 0x7f8e280c50f0 2023-08-31T00:27:54.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.509+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e280c4110 con 0x7f8e280c50f0 2023-08-31T00:27:54.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.510+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e280731e0 con 0x7f8e280c50f0 2023-08-31T00:27:54.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.510+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e1801c460 con 0x7f8e280c50f0 2023-08-31T00:27:54.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.511+0000 7f8e25ffb700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:54.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.511+0000 7f8e2d17a700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.511+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e18088dc0 con 0x7f8e280c50f0 2023-08-31T00:27:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.511+0000 7f8e2d17a700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e20001050 tx=0x7f8e20001e70 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:54.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.515+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8e18054890 con 0x7f8e280c50f0 2023-08-31T00:27:54.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:54.722+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8e28073c30 con 0x7f8e280c50f0 2023-08-31T00:27:55.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.299+0000 7f8e25ffb700 1 -- 172.21.15.77:0/2063603746 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8e18057eb0 con 0x7f8e280c50f0 2023-08-31T00:27:55.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8e1406a0e0 msgr2=0x7f8e1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e20001050 tx=0x7f8e20001e70 comp rx=0 tx=0).stop 2023-08-31T00:27:55.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 msgr2=0x7f8e280c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 0x7f8e280c5570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000bf80 tx=0x7f8e18013990 comp rx=0 tx=0).stop 2023-08-31T00:27:55.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 shutdown_connections 2023-08-31T00:27:55.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8e10005090 0x7f8e28149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e280c50f0 0x7f8e280c5570 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 --2- 172.21.15.77:0/2063603746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e280cd8e0 0x7f8e280c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 >> 172.21.15.77:0/2063603746 conn(0x7f8e280afbf0 msgr2=0x7f8e28069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:55.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 shutdown_connections 2023-08-31T00:27:55.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.301+0000 7f8e2f3de700 1 -- 172.21.15.77:0/2063603746 wait complete. 2023-08-31T00:27:55.305 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-08-31T00:27:55.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T00:27:55.442 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 -- 172.21.15.77:0/1809411102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 msgr2=0x7f240c0c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 --2- 172.21.15.77:0/1809411102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c0c96b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2404009f60 tx=0x7f2404009f90 comp rx=0 tx=0).stop 2023-08-31T00:27:55.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 -- 172.21.15.77:0/1809411102 shutdown_connections 2023-08-31T00:27:55.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 --2- 172.21.15.77:0/1809411102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c0c96b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 --2- 172.21.15.77:0/1809411102 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f240c1580f0 0x7f240c0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 -- 172.21.15.77:0/1809411102 >> 172.21.15.77:0/1809411102 conn(0x7f240c06cbf0 msgr2=0x7f240c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:55.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 -- 172.21.15.77:0/1809411102 shutdown_connections 2023-08-31T00:27:55.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.441+0000 7f2414351700 1 -- 172.21.15.77:0/1809411102 wait complete. 2023-08-31T00:27:55.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.442+0000 7f2414351700 1 Processor -- start 2023-08-31T00:27:55.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.442+0000 7f2414351700 1 -- start start 2023-08-31T00:27:55.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f2414351700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 0x7f240c1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f2414351700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f2414351700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f240c1580f0 0x7f240c1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f2414351700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0c7f60 con 0x7f240c06f130 2023-08-31T00:27:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f2414351700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c1ef820 con 0x7f240c0711d0 2023-08-31T00:27:55.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f2414351700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c1f3350 con 0x7f240c1580f0 2023-08-31T00:27:55.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 0x7f240c1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 0x7f240c1f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40494/0 (socket says 172.21.15.77:40494) 2023-08-31T00:27:55.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 -- 172.21.15.77:0/426854227 learned_addr learned my addr 172.21.15.77:0/426854227 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:55.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24128ee700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f240c1580f0 0x7f240c1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24118ec700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 -- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f240c1580f0 msgr2=0x7f240c1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f240c1580f0 0x7f240c1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 -- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 msgr2=0x7f240c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 -- 172.21.15.77:0/426854227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc009520 con 0x7f240c06f130 2023-08-31T00:27:55.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24118ec700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:55.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.443+0000 7f24120ed700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 0x7f240c1f2e10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00e9f0 tx=0x7f23fc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:55.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.444+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0097e0 con 0x7f240c06f130 2023-08-31T00:27:55.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.444+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f23fc00cbd0 con 0x7f240c06f130 2023-08-31T00:27:55.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.444+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc004020 con 0x7f240c06f130 2023-08-31T00:27:55.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.444+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2404009c40 con 0x7f240c06f130 2023-08-31T00:27:55.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.444+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c1f3860 con 0x7f240c06f130 2023-08-31T00:27:55.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.445+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c1efd80 con 0x7f240c06f130 2023-08-31T00:27:55.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.445+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23fc004180 con 0x7f240c06f130 2023-08-31T00:27:55.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.445+0000 7f2402ffd700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f23f006a0e0 0x7f23f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.445+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23fc014070 con 0x7f240c06f130 2023-08-31T00:27:55.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.445+0000 7f24118ec700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f23f006a0e0 0x7f23f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.446+0000 7f24118ec700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f23f006a0e0 0x7f23f006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f240c159890 tx=0x7f2408009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:55.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.450+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23fc054560 con 0x7f240c06f130 2023-08-31T00:27:55.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.715+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f240c073c60 con 0x7f240c06f130 2023-08-31T00:27:55.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.716+0000 7f2402ffd700 1 -- 172.21.15.77:0/426854227 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f23fc057b80 con 0x7f240c06f130 2023-08-31T00:27:55.717 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:55.717 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-08-31T00:27:55.718 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-08-31T00:27:55.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.718 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-08-31T00:27:55.718 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAX3u9kqxpyKBAA/6egwjMwFfXcQytWOSNTyw==", 2023-08-31T00:27:55.719 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.719 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.719 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-08-31T00:27:55.719 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-08-31T00:27:55.720 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.720 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-08-31T00:27:55.721 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAX3u9kn+b/NBAAlhUQVatTMWdmN77oYIZ4Vg==", 2023-08-31T00:27:55.721 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.721 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.722 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-08-31T00:27:55.722 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-08-31T00:27:55.722 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.722 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.723 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-08-31T00:27:55.723 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAX3u9kBdGmLxAA+xN2F5Mt/obBMLNEymC+LA==", 2023-08-31T00:27:55.723 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.723 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.724 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-08-31T00:27:55.724 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-08-31T00:27:55.724 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.725 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-08-31T00:27:55.725 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAY3u9khlHhABAALSUioSVCXTsY0L3wwbskQg==", 2023-08-31T00:27:55.725 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.726 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.726 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-08-31T00:27:55.726 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-08-31T00:27:55.726 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.727 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.727 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-08-31T00:27:55.727 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAb3u9kUkIKGxAAfqdXjd28aOPANxQ0svI6Hg==", 2023-08-31T00:27:55.727 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.728 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.728 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.728 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.729 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-08-31T00:27:55.729 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAe3u9k5NbCGhAA3z4sr3l/ikxtffx3N90+6A==", 2023-08-31T00:27:55.729 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.730 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.730 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.730 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.730 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.731 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-08-31T00:27:55.731 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAh3u9kDfggGhAA87dWe+8rfP4a2VhAsqupjg==", 2023-08-31T00:27:55.731 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.732 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.732 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.732 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.733 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-08-31T00:27:55.733 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAk3u9kuY5jGRAAu87fmHrPNQ4kzHtiMhIw7Q==", 2023-08-31T00:27:55.733 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.733 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.734 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.734 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.734 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.735 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-08-31T00:27:55.735 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAq3u9kGKSuHRAAoVa8AHz0DVkCOpnFujAPpg==", 2023-08-31T00:27:55.735 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.735 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.736 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.736 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.737 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-08-31T00:27:55.737 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAt3u9k/nNKHRAApU+u4tll+tAuh++ywyb1mQ==", 2023-08-31T00:27:55.737 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.737 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.737 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.738 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.738 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.738 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-08-31T00:27:55.739 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAw3u9kOpFMHRAAQFx8VIcNtkcy02NWQRHM6g==", 2023-08-31T00:27:55.739 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.739 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.739 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.739 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.740 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-08-31T00:27:55.740 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAz3u9kHiIZHRAAeCZYFSTt4hve9iA8n8Q1nA==", 2023-08-31T00:27:55.741 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.741 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-08-31T00:27:55.741 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-08-31T00:27:55.741 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.741 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.742 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-08-31T00:27:55.742 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAY3u9kZfM5BRAA3ct45RKE/VpmqgPOlkxNtQ==", 2023-08-31T00:27:55.742 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.743 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.743 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-08-31T00:27:55.743 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-08-31T00:27:55.743 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-08-31T00:27:55.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.744 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-08-31T00:27:55.744 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAY3u9kaWpJDhAAtXMXV8RA9XXr0X44O6arOA==", 2023-08-31T00:27:55.745 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.745 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.745 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-08-31T00:27:55.745 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-08-31T00:27:55.745 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-08-31T00:27:55.746 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.746 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-08-31T00:27:55.746 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAY3u9kzr/pChAAAGlha/S2piFWL4+Ywj9KNw==", 2023-08-31T00:27:55.747 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.747 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.747 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-08-31T00:27:55.747 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-08-31T00:27:55.747 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-08-31T00:27:55.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.748 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-08-31T00:27:55.748 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAY3u9kPzKbERAAUCQS5+7fZIoc0ZH1na3LzA==", 2023-08-31T00:27:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-08-31T00:27:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-08-31T00:27:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-08-31T00:27:55.749 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-08-31T00:27:55.750 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.750 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-08-31T00:27:55.750 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAX3u9k0fCpABAAkrs9oz2QYpFCPDt23ZGOSA==", 2023-08-31T00:27:55.751 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.751 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-08-31T00:27:55.751 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-08-31T00:27:55.751 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-08-31T00:27:55.751 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.751 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mds", 2023-08-31T00:27:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQA53u9kC5FyGxAAozuWWaA0NrkehMjlczYVng==", 2023-08-31T00:27:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mds" 2023-08-31T00:27:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mgr", 2023-08-31T00:27:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQA53u9keZlyGxAA1WzyxcAlBwOgNGc9P1TiVA==", 2023-08-31T00:27:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-31T00:27:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.755 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-osd", 2023-08-31T00:27:55.755 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQA53u9k9aFyGxAARX34HljF7aijg533bb7uaQ==", 2023-08-31T00:27:55.755 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.755 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-osd" 2023-08-31T00:27:55.756 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.756 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd", 2023-08-31T00:27:55.756 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQA53u9kQqlyGxAAGoTq8YJNyCgBnFtSJzYUWg==", 2023-08-31T00:27:55.757 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.757 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-31T00:27:55.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.758 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-31T00:27:55.758 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQA53u9k77ByGxAAQn/uV77s/21dImWG/RR1Aw==", 2023-08-31T00:27:55.758 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.758 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-31T00:27:55.758 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.759 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rgw", 2023-08-31T00:27:55.759 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQA53u9kjbhyGxAA1pYuHdd6hsyczYXgT6NczQ==", 2023-08-31T00:27:55.759 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.760 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-31T00:27:55.760 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.760 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-08-31T00:27:55.761 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAX3u9kig8OJRAAqwQTOU8YgLx/rg1ZBe5wBw==", 2023-08-31T00:27:55.761 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.761 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-08-31T00:27:55.761 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-08-31T00:27:55.761 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:27:55.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:55.762 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-08-31T00:27:55.762 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQAX3u9km/52HxAAxU/jjzsDmqrykxB4ZFjs9w==", 2023-08-31T00:27:55.762 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-08-31T00:27:55.763 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-08-31T00:27:55.763 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-08-31T00:27:55.763 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-08-31T00:27:55.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:55.764 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-08-31T00:27:55.764 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-08-31T00:27:55.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f23f006a0e0 msgr2=0x7f23f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f23f006a0e0 0x7f23f006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f240c159890 tx=0x7f2408009040 comp rx=0 tx=0).stop 2023-08-31T00:27:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 msgr2=0x7f240c1f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 0x7f240c1f2e10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00e9f0 tx=0x7f23fc00ed00 comp rx=0 tx=0).stop 2023-08-31T00:27:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 shutdown_connections 2023-08-31T00:27:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f23f006a0e0 0x7f23f006c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f240c1580f0 0x7f240c1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f240c06f130 0x7f240c1f2e10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 --2- 172.21.15.77:0/426854227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f240c0711d0 0x7f240c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 >> 172.21.15.77:0/426854227 conn(0x7f240c06cbf0 msgr2=0x7f240c154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 shutdown_connections 2023-08-31T00:27:55.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.718+0000 7f2414351700 1 -- 172.21.15.77:0/426854227 wait complete. 2023-08-31T00:27:55.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-31T00:27:55.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 -- 172.21.15.77:0/1056296160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc0c9ee0 msgr2=0x7f85dc159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1056296160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc0c9ee0 0x7f85dc159910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0098c0 tx=0x7f85cc009bd0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 -- 172.21.15.77:0/1056296160 shutdown_connections 2023-08-31T00:27:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1056296160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc0c9ee0 0x7f85dc159910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 -- 172.21.15.77:0/1056296160 >> 172.21.15.77:0/1056296160 conn(0x7f85dc0cf180 msgr2=0x7f85dc0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 -- 172.21.15.77:0/1056296160 shutdown_connections 2023-08-31T00:27:55.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.891+0000 7f85e1a98700 1 -- 172.21.15.77:0/1056296160 wait complete. 2023-08-31T00:27:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.892+0000 7f85e1a98700 1 Processor -- start 2023-08-31T00:27:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.892+0000 7f85e1a98700 1 -- start start 2023-08-31T00:27:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85e1a98700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85dc0c9ee0 0x7f85dc0c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85e1a98700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 0x7f85dc0c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85e1a98700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc15dc10 0x7f85dc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85e1a98700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc153ff0 con 0x7f85dc159530 2023-08-31T00:27:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85e1a98700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0c21a0 con 0x7f85dc15dc10 2023-08-31T00:27:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85e1a98700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc1533e0 con 0x7f85dc0c9ee0 2023-08-31T00:27:55.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85daffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 0x7f85dc0c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85daffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 0x7f85dc0c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40510/0 (socket says 172.21.15.77:40510) 2023-08-31T00:27:55.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.893+0000 7f85daffd700 1 -- 172.21.15.77:0/1837557234 learned_addr learned my addr 172.21.15.77:0/1837557234 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:55.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85dbfff700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc15dc10 0x7f85dc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85db7fe700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85dc0c9ee0 0x7f85dc0c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85daffd700 1 -- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85dc0c9ee0 msgr2=0x7f85dc0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85daffd700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85dc0c9ee0 0x7f85dc0c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85daffd700 1 -- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc15dc10 msgr2=0x7f85dc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:55.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85daffd700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc15dc10 0x7f85dc15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:55.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85daffd700 1 -- 172.21.15.77:0/1837557234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc009520 con 0x7f85dc159530 2023-08-31T00:27:55.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85dbfff700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc15dc10 0x7f85dc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85db7fe700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85dc0c9ee0 0x7f85dc0c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:27:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85daffd700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 0x7f85dc0c1c60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009fd0 tx=0x7f85cc003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc01c070 con 0x7f85dc159530 2023-08-31T00:27:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f85cc00b6a0 con 0x7f85dc159530 2023-08-31T00:27:55.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00ba90 con 0x7f85dc159530 2023-08-31T00:27:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc1536c0 con 0x7f85dc159530 2023-08-31T00:27:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.894+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc153c80 con 0x7f85dc159530 2023-08-31T00:27:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.895+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc153e40 con 0x7f85dc159530 2023-08-31T00:27:55.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.895+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85cc020070 con 0x7f85dc159530 2023-08-31T00:27:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.896+0000 7f85c3fff700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f85c806a0e0 0x7f85c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.896+0000 7f85db7fe700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f85c806a0e0 0x7f85c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:55.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.896+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85cc089290 con 0x7f85dc159530 2023-08-31T00:27:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.896+0000 7f85db7fe700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f85c806a0e0 0x7f85c806c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f85d0000f60 tx=0x7f85d0009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:55.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:55.900+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f85cc054f70 con 0x7f85dc159530 2023-08-31T00:27:56.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.168+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f85dc158d90 con 0x7f85dc159530 2023-08-31T00:27:56.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.172+0000 7f85c3fff700 1 -- 172.21.15.77:0/1837557234 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f85cc058590 con 0x7f85dc159530 2023-08-31T00:27:56.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f85c806a0e0 msgr2=0x7f85c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f85c806a0e0 0x7f85c806c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f85d0000f60 tx=0x7f85d0009040 comp rx=0 tx=0).stop 2023-08-31T00:27:56.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 msgr2=0x7f85dc0c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 0x7f85dc0c1c60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009fd0 tx=0x7f85cc003eb0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 shutdown_connections 2023-08-31T00:27:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f85c806a0e0 0x7f85c806c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85dc0c9ee0 0x7f85dc0c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc15dc10 0x7f85dc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 --2- 172.21.15.77:0/1837557234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85dc159530 0x7f85dc0c1c60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 >> 172.21.15.77:0/1837557234 conn(0x7f85dc0cf180 msgr2=0x7f85dc0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:56.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 shutdown_connections 2023-08-31T00:27:56.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.174+0000 7f85e1a98700 1 -- 172.21.15.77:0/1837557234 wait complete. 2023-08-31T00:27:56.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-31T00:27:56.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 -- 172.21.15.77:0/1129327242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 msgr2=0x7f065c1598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 --2- 172.21.15.77:0/1129327242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c1598f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f065c06d970 tx=0x7f064c009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:56.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 -- 172.21.15.77:0/1129327242 shutdown_connections 2023-08-31T00:27:56.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 --2- 172.21.15.77:0/1129327242 >> v2:172.21.15.139:3300/0 conn(0x7f065c069b10 0x7f065c069f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 --2- 172.21.15.77:0/1129327242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c1598f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 --2- 172.21.15.77:0/1129327242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065c0cb080 0x7f065c0cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 -- 172.21.15.77:0/1129327242 >> 172.21.15.77:0/1129327242 conn(0x7f065c06cbf0 msgr2=0x7f065c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:56.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 -- 172.21.15.77:0/1129327242 shutdown_connections 2023-08-31T00:27:56.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.312+0000 7f0661601700 1 -- 172.21.15.77:0/1129327242 wait complete. 2023-08-31T00:27:56.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.313+0000 7f0661601700 1 Processor -- start 2023-08-31T00:27:56.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.313+0000 7f0661601700 1 -- start start 2023-08-31T00:27:56.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f0661601700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f065c069b10 0x7f065c0c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f0661601700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c0ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f0661601700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065c0cb080 0x7f065c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f0661601700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0ad920 con 0x7f065c0caca0 2023-08-31T00:27:56.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f0661601700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0c4500 con 0x7f065c069b10 2023-08-31T00:27:56.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f0661601700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0cdc50 con 0x7f065c0cb080 2023-08-31T00:27:56.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f065a7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c0ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:56.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f065a7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c0ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40526/0 (socket says 172.21.15.77:40526) 2023-08-31T00:27:56.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f065a7fc700 1 -- 172.21.15.77:0/2766436322 learned_addr learned my addr 172.21.15.77:0/2766436322 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:56.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f065b7fe700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065c0cb080 0x7f065c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:56.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.314+0000 7f065affd700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f065c069b10 0x7f065c0c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:56.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f065a7fc700 1 -- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065c0cb080 msgr2=0x7f065c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f065a7fc700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065c0cb080 0x7f065c0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f065a7fc700 1 -- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f065c069b10 msgr2=0x7f065c0c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f065a7fc700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f065c069b10 0x7f065c0c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f065a7fc700 1 -- 172.21.15.77:0/2766436322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0095f0 con 0x7f065c0caca0 2023-08-31T00:27:56.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f065a7fc700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c0ad3e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f065000d980 tx=0x7f065000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:56.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650004220 con 0x7f065c0caca0 2023-08-31T00:27:56.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c0cbbf0 con 0x7f065c0caca0 2023-08-31T00:27:56.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f065000be10 con 0x7f065c0caca0 2023-08-31T00:27:56.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c0ccbd0 con 0x7f065c0caca0 2023-08-31T00:27:56.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.315+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650009940 con 0x7f065c0caca0 2023-08-31T00:27:56.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.316+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c073c30 con 0x7f065c0caca0 2023-08-31T00:27:56.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.316+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0650009aa0 con 0x7f065c0caca0 2023-08-31T00:27:56.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.317+0000 7f06437fe700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.317+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06500881f0 con 0x7f065c0caca0 2023-08-31T00:27:56.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.317+0000 7f065affd700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:56.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.317+0000 7f065affd700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f064806a0e0 0x7f064806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f064c0098e0 tx=0x7f064c0047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:56.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.321+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0650053ca0 con 0x7f065c0caca0 2023-08-31T00:27:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.592+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f065c159eb0 con 0x7f065c0caca0 2023-08-31T00:27:56.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.596+0000 7f06437fe700 1 -- 172.21.15.77:0/2766436322 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f06500572c0 con 0x7f065c0caca0 2023-08-31T00:27:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f064806a0e0 msgr2=0x7f064806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f064806a0e0 0x7f064806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f064c0098e0 tx=0x7f064c0047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 msgr2=0x7f065c0ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c0ad3e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f065000d980 tx=0x7f065000dd40 comp rx=0 tx=0).stop 2023-08-31T00:27:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 shutdown_connections 2023-08-31T00:27:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065c0cb080 0x7f065c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f065c069b10 0x7f065c0c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 --2- 172.21.15.77:0/2766436322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0caca0 0x7f065c0ad3e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 >> 172.21.15.77:0/2766436322 conn(0x7f065c06cbf0 msgr2=0x7f065c1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 shutdown_connections 2023-08-31T00:27:56.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.598+0000 7f0661601700 1 -- 172.21.15.77:0/2766436322 wait complete. 2023-08-31T00:27:56.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-31T00:27:56.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.733+0000 7f3c883a4700 1 -- 172.21.15.77:0/2909141893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 msgr2=0x7f3c6c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.733+0000 7f3c883a4700 1 --2- 172.21.15.77:0/2909141893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c6c004cd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3c70005fd0 tx=0x7f3c6c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.734+0000 7f3c883a4700 1 -- 172.21.15.77:0/2909141893 shutdown_connections 2023-08-31T00:27:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.734+0000 7f3c883a4700 1 --2- 172.21.15.77:0/2909141893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c6c004cd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.734+0000 7f3c883a4700 1 -- 172.21.15.77:0/2909141893 >> 172.21.15.77:0/2909141893 conn(0x7f3c8006cbf0 msgr2=0x7f3c8006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:56.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.734+0000 7f3c883a4700 1 -- 172.21.15.77:0/2909141893 shutdown_connections 2023-08-31T00:27:56.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.734+0000 7f3c883a4700 1 -- 172.21.15.77:0/2909141893 wait complete. 2023-08-31T00:27:56.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.735+0000 7f3c883a4700 1 Processor -- start 2023-08-31T00:27:56.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.735+0000 7f3c883a4700 1 -- start start 2023-08-31T00:27:56.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c883a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c80151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c883a4700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3c80151870 0x7f3c80150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c883a4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c801505d0 0x7f3c800c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c883a4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80150f10 con 0x7f3c6c004850 2023-08-31T00:27:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c883a4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c801ee8b0 con 0x7f3c801505d0 2023-08-31T00:27:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c883a4700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c80154d90 con 0x7f3c80151870 2023-08-31T00:27:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c80151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c80151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40544/0 (socket says 172.21.15.77:40544) 2023-08-31T00:27:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 -- 172.21.15.77:0/224450519 learned_addr learned my addr 172.21.15.77:0/224450519 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:56.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 -- 172.21.15.77:0/224450519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3c80151870 msgr2=0x7f3c80150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3c80151870 0x7f3c80150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 -- 172.21.15.77:0/224450519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c801505d0 msgr2=0x7f3c800c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:56.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c801505d0 0x7f3c800c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:56.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.736+0000 7f3c86140700 1 -- 172.21.15.77:0/224450519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80155070 con 0x7f3c6c004850 2023-08-31T00:27:56.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.737+0000 7f3c86140700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c80151330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00f620 tx=0x7f3c7c00f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:56.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.737+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00d480 con 0x7f3c6c004850 2023-08-31T00:27:56.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.737+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c7c006380 con 0x7f3c6c004850 2023-08-31T00:27:56.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.737+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c80155350 con 0x7f3c6c004850 2023-08-31T00:27:56.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.737+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0038c0 con 0x7f3c6c004850 2023-08-31T00:27:56.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.737+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c80154380 con 0x7f3c6c004850 2023-08-31T00:27:56.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.738+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c80151050 con 0x7f3c6c004850 2023-08-31T00:27:56.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.738+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c7c003a20 con 0x7f3c6c004850 2023-08-31T00:27:56.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.739+0000 7f3c76ffd700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3c6406a0e0 0x7f3c6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:56.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.739+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c7c088240 con 0x7f3c6c004850 2023-08-31T00:27:56.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.739+0000 7f3c8593f700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3c6406a0e0 0x7f3c6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:56.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.739+0000 7f3c8593f700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3c6406a0e0 0x7f3c6406c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c800c4c30 tx=0x7f3c700047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:56.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:56.743+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c80151050 con 0x7f3c6c004850 2023-08-31T00:27:57.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.008+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3c80151050 con 0x7f3c6c004850 2023-08-31T00:27:57.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.011+0000 7f3c76ffd700 1 -- 172.21.15.77:0/224450519 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3c80151050 con 0x7f3c6c004850 2023-08-31T00:27:57.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3c6406a0e0 msgr2=0x7f3c6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3c6406a0e0 0x7f3c6406c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3c800c4c30 tx=0x7f3c700047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 msgr2=0x7f3c80151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c80151330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00f620 tx=0x7f3c7c00f9e0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 shutdown_connections 2023-08-31T00:27:57.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3c6406a0e0 0x7f3c6406c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c801505d0 0x7f3c800c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c6c004850 0x7f3c80151330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 --2- 172.21.15.77:0/224450519 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3c80151870 0x7f3c80150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.013+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 >> 172.21.15.77:0/224450519 conn(0x7f3c8006cbf0 msgr2=0x7f3c8015b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.014+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 shutdown_connections 2023-08-31T00:27:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.014+0000 7f3c883a4700 1 -- 172.21.15.77:0/224450519 wait complete. 2023-08-31T00:27:57.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-31T00:27:57.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:27:57.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:27:57.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.152+0000 7f77faf16700 1 -- 172.21.15.77:0/1714241484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 msgr2=0x7f77f40c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.152+0000 7f77faf16700 1 --2- 172.21.15.77:0/1714241484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40c9d10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009fd0 tx=0x7f77ec00b380 comp rx=0 tx=0).stop 2023-08-31T00:27:57.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.152+0000 7f77faf16700 1 -- 172.21.15.77:0/1714241484 shutdown_connections 2023-08-31T00:27:57.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.152+0000 7f77faf16700 1 --2- 172.21.15.77:0/1714241484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40c9d10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.152+0000 7f77faf16700 1 --2- 172.21.15.77:0/1714241484 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77f4159530 0x7f77f40c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.152+0000 7f77faf16700 1 -- 172.21.15.77:0/1714241484 >> 172.21.15.77:0/1714241484 conn(0x7f77f40cf180 msgr2=0x7f77f40cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:57.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.153+0000 7f77faf16700 1 -- 172.21.15.77:0/1714241484 shutdown_connections 2023-08-31T00:27:57.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.153+0000 7f77faf16700 1 -- 172.21.15.77:0/1714241484 wait complete. 2023-08-31T00:27:57.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.154+0000 7f77faf16700 1 Processor -- start 2023-08-31T00:27:57.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.154+0000 7f77faf16700 1 -- start start 2023-08-31T00:27:57.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.154+0000 7f77faf16700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77f4159530 0x7f77f41570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.154+0000 7f77faf16700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77faf16700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77f415dc10 0x7f77f4154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77faf16700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40b2540 con 0x7f77f415a020 2023-08-31T00:27:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77faf16700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40b1d30 con 0x7f77f415dc10 2023-08-31T00:27:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77faf16700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40b1f80 con 0x7f77f4159530 2023-08-31T00:27:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40558/0 (socket says 172.21.15.77:40558) 2023-08-31T00:27:57.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 -- 172.21.15.77:0/1178269827 learned_addr learned my addr 172.21.15.77:0/1178269827 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:57.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f8cb2700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77f4159530 0x7f77f41570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 -- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77f4159530 msgr2=0x7f77f41570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77f4159530 0x7f77f41570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 -- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77f415dc10 msgr2=0x7f77f4154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f94b3700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77f415dc10 0x7f77f4154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77f415dc10 0x7f77f4154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 -- 172.21.15.77:0/1178269827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec009d00 con 0x7f77f415a020 2023-08-31T00:27:57.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f3fff700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40cebb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f77e000c420 tx=0x7f77e000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:57.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00052d0 con 0x7f77f415a020 2023-08-31T00:27:57.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77e0005520 con 0x7f77f415a020 2023-08-31T00:27:57.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f40b2260 con 0x7f77f415a020 2023-08-31T00:27:57.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00038e0 con 0x7f77f415a020 2023-08-31T00:27:57.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.155+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f41441b0 con 0x7f77f415a020 2023-08-31T00:27:57.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.156+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f4143d30 con 0x7f77f415a020 2023-08-31T00:27:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.157+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f77e0003a40 con 0x7f77f415a020 2023-08-31T00:27:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.157+0000 7f77f17fa700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f77d806a0e0 0x7f77d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.157+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f77e0087750 con 0x7f77f415a020 2023-08-31T00:27:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.157+0000 7f77f8cb2700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f77d806a0e0 0x7f77d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.157+0000 7f77f8cb2700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f77d806a0e0 0x7f77d806c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77e8005950 tx=0x7f77e80058e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:57.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.161+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f77f4143d30 con 0x7f77f415a020 2023-08-31T00:27:57.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.428+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f77f4143d30 con 0x7f77f415a020 2023-08-31T00:27:57.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.432+0000 7f77f17fa700 1 -- 172.21.15.77:0/1178269827 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f77f4143d30 con 0x7f77f415a020 2023-08-31T00:27:57.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f77d806a0e0 msgr2=0x7f77d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.435 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f77d806a0e0 0x7f77d806c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77e8005950 tx=0x7f77e80058e0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 msgr2=0x7f77f40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40cebb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f77e000c420 tx=0x7f77e000c7e0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 shutdown_connections 2023-08-31T00:27:57.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f77d806a0e0 0x7f77d806c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.436 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77f4159530 0x7f77f41570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77f415dc10 0x7f77f4154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 --2- 172.21.15.77:0/1178269827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77f415a020 0x7f77f40cebb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 >> 172.21.15.77:0/1178269827 conn(0x7f77f40cf180 msgr2=0x7f77f415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:57.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 shutdown_connections 2023-08-31T00:27:57.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.434+0000 7f77faf16700 1 -- 172.21.15.77:0/1178269827 wait complete. 2023-08-31T00:27:57.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-31T00:27:57.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 -- 172.21.15.77:0/1200685124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 msgr2=0x7f4330070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 --2- 172.21.15.77:0/1200685124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330070ac0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f43300adaf0 tx=0x7f4320009ba0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 -- 172.21.15.77:0/1200685124 shutdown_connections 2023-08-31T00:27:57.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 --2- 172.21.15.77:0/1200685124 >> v2:172.21.15.139:3300/0 conn(0x7f4330071000 0x7f43300c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 --2- 172.21.15.77:0/1200685124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330070ac0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 -- 172.21.15.77:0/1200685124 >> 172.21.15.77:0/1200685124 conn(0x7f433006cbf0 msgr2=0x7f433006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:57.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 -- 172.21.15.77:0/1200685124 shutdown_connections 2023-08-31T00:27:57.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.610+0000 7f4336680700 1 -- 172.21.15.77:0/1200685124 wait complete. 2023-08-31T00:27:57.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.611+0000 7f4336680700 1 Processor -- start 2023-08-31T00:27:57.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 -- start start 2023-08-31T00:27:57.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4330071000 0x7f43301eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43301580f0 0x7f4330150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301550b0 con 0x7f433006f130 2023-08-31T00:27:57.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43301f2f20 con 0x7f4330071000 2023-08-31T00:27:57.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f4336680700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43301f3200 con 0x7f43301580f0 2023-08-31T00:27:57.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f432ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f432ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40570/0 (socket says 172.21.15.77:40570) 2023-08-31T00:27:57.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.612+0000 7f432ffff700 1 -- 172.21.15.77:0/1265713449 learned_addr learned my addr 172.21.15.77:0/1265713449 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:57.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f4334c1d700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43301580f0 0x7f4330150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432ffff700 1 -- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43301580f0 msgr2=0x7f4330150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432ffff700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43301580f0 0x7f4330150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432ffff700 1 -- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4330071000 msgr2=0x7f43301eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432ffff700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4330071000 0x7f43301eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432ffff700 1 -- 172.21.15.77:0/1265713449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009520 con 0x7f433006f130 2023-08-31T00:27:57.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432ffff700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330154b70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f432400c550 tx=0x7f432400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:57.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240054e0 con 0x7f433006f130 2023-08-31T00:27:57.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4324003680 con 0x7f433006f130 2023-08-31T00:27:57.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43301f34e0 con 0x7f433006f130 2023-08-31T00:27:57.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324003a90 con 0x7f433006f130 2023-08-31T00:27:57.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.613+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433014f730 con 0x7f433006f130 2023-08-31T00:27:57.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.614+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43301f3a00 con 0x7f433006f130 2023-08-31T00:27:57.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.614+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4324003bf0 con 0x7f433006f130 2023-08-31T00:27:57.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.615+0000 7f432cff9700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f431c06a0e0 0x7f431c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:57.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.615+0000 7f432f7fe700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f431c06a0e0 0x7f431c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:57.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.615+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4324087530 con 0x7f433006f130 2023-08-31T00:27:57.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.615+0000 7f432f7fe700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f431c06a0e0 0x7f431c06c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43300c3100 tx=0x7f4320004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:57.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.619+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43301f3a00 con 0x7f433006f130 2023-08-31T00:27:57.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.885+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4330071450 con 0x7f433006f130 2023-08-31T00:27:57.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.889+0000 7f432cff9700 1 -- 172.21.15.77:0/1265713449 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4330071450 con 0x7f433006f130 2023-08-31T00:27:57.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f431c06a0e0 msgr2=0x7f431c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f431c06a0e0 0x7f431c06c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43300c3100 tx=0x7f4320004750 comp rx=0 tx=0).stop 2023-08-31T00:27:57.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 msgr2=0x7f4330154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:57.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330154b70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f432400c550 tx=0x7f432400c910 comp rx=0 tx=0).stop 2023-08-31T00:27:57.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 shutdown_connections 2023-08-31T00:27:57.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f431c06a0e0 0x7f431c06c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43301580f0 0x7f4330150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f433006f130 0x7f4330154b70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 --2- 172.21.15.77:0/1265713449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4330071000 0x7f43301eed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:57.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 >> 172.21.15.77:0/1265713449 conn(0x7f433006cbf0 msgr2=0x7f4330151470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:57.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 shutdown_connections 2023-08-31T00:27:57.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:57.891+0000 7f4336680700 1 -- 172.21.15.77:0/1265713449 wait complete. 2023-08-31T00:27:57.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-31T00:27:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/2723918307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380c9ee0 msgr2=0x7f9b38159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/2723918307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380c9ee0 0x7f9b38159910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9b380cb410 tx=0x7f9b28009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/2723918307 shutdown_connections 2023-08-31T00:27:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/2723918307 >> v2:172.21.15.139:3300/0 conn(0x7f9b3815dc10 0x7f9b38159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/2723918307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b380c9ee0 0x7f9b38159910 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/2723918307 >> 172.21.15.77:0/2723918307 conn(0x7f9b380cf180 msgr2=0x7f9b380cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/2723918307 shutdown_connections 2023-08-31T00:27:58.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.026+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/2723918307 wait complete. 2023-08-31T00:27:58.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.027+0000 7f9b3e5ef700 1 Processor -- start 2023-08-31T00:27:58.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 -- start start 2023-08-31T00:27:58.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b380c9ee0 0x7f9b38154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 0x7f9b380c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3815dc10 0x7f9b380c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380c2190 con 0x7f9b38159530 2023-08-31T00:27:58.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381493c0 con 0x7f9b3815dc10 2023-08-31T00:27:58.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b3e5ef700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380b1a20 con 0x7f9b380c9ee0 2023-08-31T00:27:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 0x7f9b380c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b377fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 0x7f9b380c1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40586/0 (socket says 172.21.15.77:40586) 2023-08-31T00:27:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b377fe700 1 -- 172.21.15.77:0/939805868 learned_addr learned my addr 172.21.15.77:0/939805868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.028+0000 7f9b37fff700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b380c9ee0 0x7f9b38154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b3cb8c700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3815dc10 0x7f9b380c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b377fe700 1 -- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b380c9ee0 msgr2=0x7f9b38154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b377fe700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b380c9ee0 0x7f9b38154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b377fe700 1 -- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3815dc10 msgr2=0x7f9b380c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b377fe700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3815dc10 0x7f9b380c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b377fe700 1 -- 172.21.15.77:0/939805868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280095f0 con 0x7f9b38159530 2023-08-31T00:27:58.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b377fe700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 0x7f9b380c1710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9b28000c00 tx=0x7f9b280050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:58.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2801d070 con 0x7f9b38159530 2023-08-31T00:27:58.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9b28004260 con 0x7f9b38159530 2023-08-31T00:27:58.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b380aebf0 con 0x7f9b38159530 2023-08-31T00:27:58.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800b760 con 0x7f9b38159530 2023-08-31T00:27:58.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.029+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b380af1b0 con 0x7f9b38159530 2023-08-31T00:27:58.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.030+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b38073c30 con 0x7f9b38159530 2023-08-31T00:27:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.030+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b2800b8c0 con 0x7f9b38159530 2023-08-31T00:27:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.031+0000 7f9b34ff9700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9b2406a0e0 0x7f9b2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.031+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b28089740 con 0x7f9b38159530 2023-08-31T00:27:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.031+0000 7f9b37fff700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9b2406a0e0 0x7f9b2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.031+0000 7f9b37fff700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9b2406a0e0 0x7f9b2406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c001730 tx=0x7f9b2c009040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:58.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.035+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b28055300 con 0x7f9b38159530 2023-08-31T00:27:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.301+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9b380cff90 con 0x7f9b38159530 2023-08-31T00:27:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.309+0000 7f9b34ff9700 1 -- 172.21.15.77:0/939805868 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9b28027020 con 0x7f9b38159530 2023-08-31T00:27:58.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9b2406a0e0 msgr2=0x7f9b2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9b2406a0e0 0x7f9b2406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c001730 tx=0x7f9b2c009040 comp rx=0 tx=0).stop 2023-08-31T00:27:58.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 msgr2=0x7f9b380c1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 0x7f9b380c1710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9b28000c00 tx=0x7f9b280050d0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 shutdown_connections 2023-08-31T00:27:58.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f9b2406a0e0 0x7f9b2406c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b380c9ee0 0x7f9b38154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3815dc10 0x7f9b380c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 --2- 172.21.15.77:0/939805868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b38159530 0x7f9b380c1710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.311+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 >> 172.21.15.77:0/939805868 conn(0x7f9b380cf180 msgr2=0x7f9b38156b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.312+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 shutdown_connections 2023-08-31T00:27:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.312+0000 7f9b3e5ef700 1 -- 172.21.15.77:0/939805868 wait complete. 2023-08-31T00:27:58.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:27:58.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.445+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3402626974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed8071000 msgr2=0x7f7ed80c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.445+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3402626974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed8071000 0x7f7ed80c96b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80c1750 tx=0x7f7ed000b330 comp rx=0 tx=0).stop 2023-08-31T00:27:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.446+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3402626974 shutdown_connections 2023-08-31T00:27:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.446+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3402626974 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed8071000 0x7f7ed80c96b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.446+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3402626974 >> v2:172.21.15.139:3300/0 conn(0x7f7ed806f130 0x7f7ed8070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.446+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3402626974 >> 172.21.15.77:0/3402626974 conn(0x7f7ed806cbf0 msgr2=0x7f7ed806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.446+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3402626974 shutdown_connections 2023-08-31T00:27:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.446+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3402626974 wait complete. 2023-08-31T00:27:58.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.447+0000 7f7ede3fc700 1 Processor -- start 2023-08-31T00:27:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.447+0000 7f7ede3fc700 1 -- start start 2023-08-31T00:27:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 0x7f7ed80c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed8071000 0x7f7ed814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7ed81580f0 0x7f7ed81e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80c25b0 con 0x7f7ed806f130 2023-08-31T00:27:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81e36e0 con 0x7f7ed8071000 2023-08-31T00:27:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80c1c80 con 0x7f7ed81580f0 2023-08-31T00:27:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 0x7f7ed80c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 0x7f7ed80c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40598/0 (socket says 172.21.15.77:40598) 2023-08-31T00:27:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 -- 172.21.15.77:0/3098234202 learned_addr learned my addr 172.21.15.77:0/3098234202 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed77fe700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed8071000 0x7f7ed814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7edc999700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7ed81580f0 0x7f7ed81e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 -- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7ed81580f0 msgr2=0x7f7ed81e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7ed81580f0 0x7f7ed81e2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 -- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed8071000 msgr2=0x7f7ed814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed8071000 0x7f7ed814f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.455 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 -- 172.21.15.77:0/3098234202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0009c40 con 0x7f7ed806f130 2023-08-31T00:27:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7edc999700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7ed81580f0 0x7f7ed81e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed77fe700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed8071000 0x7f7ed814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed7fff700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 0x7f7ed80c50f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c550 tx=0x7f7ec000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00054e0 con 0x7f7ed806f130 2023-08-31T00:27:58.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ec0003680 con 0x7f7ed806f130 2023-08-31T00:27:58.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed80c1f60 con 0x7f7ed806f130 2023-08-31T00:27:58.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.448+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0003a90 con 0x7f7ed806f130 2023-08-31T00:27:58.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.449+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed80c5630 con 0x7f7ed806f130 2023-08-31T00:27:58.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.449+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8073c30 con 0x7f7ed806f130 2023-08-31T00:27:58.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.450+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ec0003bf0 con 0x7f7ed806f130 2023-08-31T00:27:58.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.450+0000 7f7ed4ff9700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7eb806a0e0 0x7f7eb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.450+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ec00874a0 con 0x7f7ed806f130 2023-08-31T00:27:58.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.450+0000 7f7ed77fe700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7eb806a0e0 0x7f7eb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.451+0000 7f7ed77fe700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7eb806a0e0 0x7f7eb806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8005950 tx=0x7f7ec80058e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:58.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.455+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ec0053060 con 0x7f7ed806f130 2023-08-31T00:27:58.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.646+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ed8071450 con 0x7f7ed806f130 2023-08-31T00:27:58.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.647+0000 7f7ed4ff9700 1 -- 172.21.15.77:0/3098234202 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12845 (secure 0 0 0) 0x7f7ed8071450 con 0x7f7ed806f130 2023-08-31T00:27:58.648 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:58.648 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:27:55.305591+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:27:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7eb806a0e0 msgr2=0x7f7eb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7eb806a0e0 0x7f7eb806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8005950 tx=0x7f7ec80058e0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 msgr2=0x7f7ed80c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 0x7f7ed80c50f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c550 tx=0x7f7ec000c910 comp rx=0 tx=0).stop 2023-08-31T00:27:58.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 shutdown_connections 2023-08-31T00:27:58.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f7eb806a0e0 0x7f7eb806c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7ed81580f0 0x7f7ed81e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed806f130 0x7f7ed80c50f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 --2- 172.21.15.77:0/3098234202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ed8071000 0x7f7ed814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 >> 172.21.15.77:0/3098234202 conn(0x7f7ed806cbf0 msgr2=0x7f7ed81568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:58.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 shutdown_connections 2023-08-31T00:27:58.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.649+0000 7f7ede3fc700 1 -- 172.21.15.77:0/3098234202 wait complete. 2023-08-31T00:27:58.662 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T00:26:46.157659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T00:27:58.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T00:27:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 -- 172.21.15.77:0/2170468968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f815c003a00 msgr2=0x7f815c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2170468968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f815c003a00 0x7f815c003e20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8168001720 tx=0x7f815c005880 comp rx=0 tx=0).stop 2023-08-31T00:27:58.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 -- 172.21.15.77:0/2170468968 shutdown_connections 2023-08-31T00:27:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2170468968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f815c003a00 0x7f815c003e20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 -- 172.21.15.77:0/2170468968 >> 172.21.15.77:0/2170468968 conn(0x7f817406cbf0 msgr2=0x7f817406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 -- 172.21.15.77:0/2170468968 shutdown_connections 2023-08-31T00:27:58.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.788+0000 7f8179ccd700 1 -- 172.21.15.77:0/2170468968 wait complete. 2023-08-31T00:27:58.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.790+0000 7f8179ccd700 1 Processor -- start 2023-08-31T00:27:58.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.790+0000 7f8179ccd700 1 -- start start 2023-08-31T00:27:58.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f815c003a00 0x7f81740c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81741e4230 0x7f81740c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 0x7f81740c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174152500 con 0x7f8174151330 2023-08-31T00:27:58.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174152750 con 0x7f81741e4230 2023-08-31T00:27:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8174152a30 con 0x7f815c003a00 2023-08-31T00:27:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 0x7f81740c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 0x7f81740c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40622/0 (socket says 172.21.15.77:40622) 2023-08-31T00:27:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 -- 172.21.15.77:0/2891220234 learned_addr learned my addr 172.21.15.77:0/2891220234 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:58.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f81737fe700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f815c003a00 0x7f81740c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8172ffd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81741e4230 0x7f81740c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 -- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f815c003a00 msgr2=0x7f81740c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f815c003a00 0x7f81740c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 -- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81741e4230 msgr2=0x7f81740c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81741e4230 0x7f81740c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 -- 172.21.15.77:0/2891220234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174152d10 con 0x7f8174151330 2023-08-31T00:27:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8173fff700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 0x7f81740c50f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f81740cb650 tx=0x7f816c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c004bb0 con 0x7f8174151330 2023-08-31T00:27:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f816c004d30 con 0x7f8174151330 2023-08-31T00:27:58.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8174152ff0 con 0x7f8174151330 2023-08-31T00:27:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.791+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c012a70 con 0x7f8174151330 2023-08-31T00:27:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.792+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740c2e80 con 0x7f8174151330 2023-08-31T00:27:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.792+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81741531e0 con 0x7f8174151330 2023-08-31T00:27:58.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.793+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f816c019070 con 0x7f8174151330 2023-08-31T00:27:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.793+0000 7f815bfff700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f816006a0e0 0x7f816006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:58.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.793+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f816c08a2f0 con 0x7f8174151330 2023-08-31T00:27:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.793+0000 7f81737fe700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f816006a0e0 0x7f816006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.794+0000 7f81737fe700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f816006a0e0 0x7f816006c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8168001720 tx=0x7f8168001190 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:58.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.798+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f816c055e30 con 0x7f8174151330 2023-08-31T00:27:58.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.984+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8174073c30 con 0x7f8174151330 2023-08-31T00:27:58.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.985+0000 7f815bfff700 1 -- 172.21.15.77:0/2891220234 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f816c059450 con 0x7f8174151330 2023-08-31T00:27:58.986 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-08-31T00:27:58.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f816006a0e0 msgr2=0x7f816006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f816006a0e0 0x7f816006c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8168001720 tx=0x7f8168001190 comp rx=0 tx=0).stop 2023-08-31T00:27:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 msgr2=0x7f81740c50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 0x7f81740c50f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f81740cb650 tx=0x7f816c007df0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 shutdown_connections 2023-08-31T00:27:58.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f816006a0e0 0x7f816006c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f815c003a00 0x7f81740c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8174151330 0x7f81740c50f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 --2- 172.21.15.77:0/2891220234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81741e4230 0x7f81740c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:58.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 >> 172.21.15.77:0/2891220234 conn(0x7f817406cbf0 msgr2=0x7f81741546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:58.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 shutdown_connections 2023-08-31T00:27:58.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:58.987+0000 7f8179ccd700 1 -- 172.21.15.77:0/2891220234 wait complete. 2023-08-31T00:27:59.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T00:27:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.122+0000 7f74ed3ef700 1 -- 172.21.15.77:0/3152974474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 msgr2=0x7f74e8070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.122+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/3152974474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e8070ac0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f74d8005fd0 tx=0x7f74d8009c70 comp rx=0 tx=0).stop 2023-08-31T00:27:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.122+0000 7f74ed3ef700 1 -- 172.21.15.77:0/3152974474 shutdown_connections 2023-08-31T00:27:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.122+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/3152974474 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 0x7f74e80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.122+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/3152974474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e8070ac0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.122+0000 7f74ed3ef700 1 -- 172.21.15.77:0/3152974474 >> 172.21.15.77:0/3152974474 conn(0x7f74e806cbf0 msgr2=0x7f74e806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.123+0000 7f74ed3ef700 1 -- 172.21.15.77:0/3152974474 shutdown_connections 2023-08-31T00:27:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.123+0000 7f74ed3ef700 1 -- 172.21.15.77:0/3152974474 wait complete. 2023-08-31T00:27:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.124+0000 7f74ed3ef700 1 Processor -- start 2023-08-31T00:27:59.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.124+0000 7f74ed3ef700 1 -- start start 2023-08-31T00:27:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e80c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 0x7f74e80c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e81580f0 0x7f74e80c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e814afd0 con 0x7f74e806f130 2023-08-31T00:27:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e81f58c0 con 0x7f74e81580f0 2023-08-31T00:27:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e814b220 con 0x7f74e8071000 2023-08-31T00:27:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e80c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e80c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40632/0 (socket says 172.21.15.77:40632) 2023-08-31T00:27:59.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 -- 172.21.15.77:0/594990693 learned_addr learned my addr 172.21.15.77:0/594990693 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:59.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e67fc700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 0x7f74e80c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:59.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e77fe700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e81580f0 0x7f74e80c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:59.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 -- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 msgr2=0x7f74e80c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 0x7f74e80c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 -- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e81580f0 msgr2=0x7f74e80c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e81580f0 0x7f74e80c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 -- 172.21.15.77:0/594990693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80095f0 con 0x7f74e806f130 2023-08-31T00:27:59.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e67fc700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 0x7f74e80c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:27:59.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74e6ffd700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e80c3d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00b4a0 tx=0x7f74dc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:59.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc011830 con 0x7f74e806f130 2023-08-31T00:27:59.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f74dc011a80 con 0x7f74e806f130 2023-08-31T00:27:59.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e814b500 con 0x7f74e806f130 2023-08-31T00:27:59.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc011e90 con 0x7f74e806f130 2023-08-31T00:27:59.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.125+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e814bd00 con 0x7f74e806f130 2023-08-31T00:27:59.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.126+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e814ba20 con 0x7f74e806f130 2023-08-31T00:27:59.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.127+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74dc01a400 con 0x7f74e806f130 2023-08-31T00:27:59.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.127+0000 7f74cf7fe700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f74d406a0e0 0x7f74d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.127+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f74dc087fe0 con 0x7f74e806f130 2023-08-31T00:27:59.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.127+0000 7f74e67fc700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f74d406a0e0 0x7f74d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:59.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.127+0000 7f74e67fc700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f74d406a0e0 0x7f74d406c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f74d8000c00 tx=0x7f74d80047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:59.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.131+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f74e814ba20 con 0x7f74e806f130 2023-08-31T00:27:59.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.324+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74e814ba20 con 0x7f74e806f130 2023-08-31T00:27:59.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.324+0000 7f74cf7fe700 1 -- 172.21.15.77:0/594990693 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f74e814ba20 con 0x7f74e806f130 2023-08-31T00:27:59.325 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:27:59.326 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-08-31T00:27:59.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-08-31T00:27:59.326 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-08-31T00:27:59.326 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-08-31T00:27:59.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:27:59.327 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-08-31T00:27:59.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.326+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f74d406a0e0 msgr2=0x7f74d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.326+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f74d406a0e0 0x7f74d406c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f74d8000c00 tx=0x7f74d80047c0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.326+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 msgr2=0x7f74e80c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.326+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e80c3d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00b4a0 tx=0x7f74dc00b860 comp rx=0 tx=0).stop 2023-08-31T00:27:59.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.326+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 shutdown_connections 2023-08-31T00:27:59.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.326+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f74d406a0e0 0x7f74d406c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.327+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74e81580f0 0x7f74e80c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.327+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74e806f130 0x7f74e80c3d20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.327+0000 7f74ed3ef700 1 --2- 172.21.15.77:0/594990693 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74e8071000 0x7f74e80c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.327+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 >> 172.21.15.77:0/594990693 conn(0x7f74e806cbf0 msgr2=0x7f74e80adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:59.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.327+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 shutdown_connections 2023-08-31T00:27:59.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.327+0000 7f74ed3ef700 1 -- 172.21.15.77:0/594990693 wait complete. 2023-08-31T00:27:59.339 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T00:27:59.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-31T00:27:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 -- 172.21.15.77:0/4193480025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 msgr2=0x7fd65c0ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 --2- 172.21.15.77:0/4193480025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ccd00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd65c06e730 tx=0x7fd65400b330 comp rx=0 tx=0).stop 2023-08-31T00:27:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 -- 172.21.15.77:0/4193480025 shutdown_connections 2023-08-31T00:27:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 --2- 172.21.15.77:0/4193480025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ccd00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 --2- 172.21.15.77:0/4193480025 >> v2:172.21.15.139:3300/0 conn(0x7fd65c0cb450 0x7fd65c0cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 -- 172.21.15.77:0/4193480025 >> 172.21.15.77:0/4193480025 conn(0x7fd65c069b10 msgr2=0x7fd65c069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:27:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 -- 172.21.15.77:0/4193480025 shutdown_connections 2023-08-31T00:27:59.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.465+0000 7fd663b38700 1 -- 172.21.15.77:0/4193480025 wait complete. 2023-08-31T00:27:59.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.466+0000 7fd663b38700 1 Processor -- start 2023-08-31T00:27:59.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.466+0000 7fd663b38700 1 -- start start 2023-08-31T00:27:59.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd663b38700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd65c0cb450 0x7fd65c1f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd663b38700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd663b38700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c159220 0x7fd65c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd663b38700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0af1b0 con 0x7fd65c0cc080 2023-08-31T00:27:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd663b38700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0af490 con 0x7fd65c159220 2023-08-31T00:27:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd663b38700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0af770 con 0x7fd65c0cb450 2023-08-31T00:27:59.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd6610d3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd6610d3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40648/0 (socket says 172.21.15.77:40648) 2023-08-31T00:27:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd6610d3700 1 -- 172.21.15.77:0/2299645233 learned_addr learned my addr 172.21.15.77:0/2299645233 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:27:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd6610d3700 1 -- 172.21.15.77:0/2299645233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd65c0cb450 msgr2=0x7fd65c1f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.467+0000 7fd6610d3700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd65c0cb450 0x7fd65c1f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6610d3700 1 -- 172.21.15.77:0/2299645233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c159220 msgr2=0x7fd65c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:27:59.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6610d3700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c159220 0x7fd65c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:27:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6610d3700 1 -- 172.21.15.77:0/2299645233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654009c40 con 0x7fd65c0cc080 2023-08-31T00:27:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6610d3700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ae820 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd65800c9b0 tx=0x7fd65800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658007b00 con 0x7fd65c0cc080 2023-08-31T00:27:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd658007d50 con 0x7fd65c0cc080 2023-08-31T00:27:59.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c0afa50 con 0x7fd65c0cc080 2023-08-31T00:27:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800f6b0 con 0x7fd65c0cc080 2023-08-31T00:27:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.468+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c0aed60 con 0x7fd65c0cc080 2023-08-31T00:27:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.469+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c0aff70 con 0x7fd65c0cc080 2023-08-31T00:27:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.469+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd65800f810 con 0x7fd65c0cc080 2023-08-31T00:27:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.469+0000 7fd6527fc700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd64006a0e0 0x7fd64006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:27:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.470+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd658088890 con 0x7fd65c0cc080 2023-08-31T00:27:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.470+0000 7fd6618d4700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd64006a0e0 0x7fd64006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:27:59.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.470+0000 7fd6618d4700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd64006a0e0 0x7fd64006c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b03b0 tx=0x7fd64c0079c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:27:59.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.474+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd65c0aff70 con 0x7fd65c0cc080 2023-08-31T00:27:59.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:27:59.661+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd65c0aff70 con 0x7fd65c0cc080 2023-08-31T00:28:00.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.313+0000 7fd6527fc700 1 -- 172.21.15.77:0/2299645233 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd65c0aff70 con 0x7fd65c0cc080 2023-08-31T00:28:00.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd64006a0e0 msgr2=0x7fd64006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:00.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd64006a0e0 0x7fd64006c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0b03b0 tx=0x7fd64c0079c0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 msgr2=0x7fd65c0ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:00.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ae820 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd65800c9b0 tx=0x7fd65800cd70 comp rx=0 tx=0).stop 2023-08-31T00:28:00.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 shutdown_connections 2023-08-31T00:28:00.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fd64006a0e0 0x7fd64006c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd65c0cb450 0x7fd65c1f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c159220 0x7fd65c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 --2- 172.21.15.77:0/2299645233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd65c0cc080 0x7fd65c0ae820 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.318+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 >> 172.21.15.77:0/2299645233 conn(0x7fd65c069b10 msgr2=0x7fd65c1e4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:00.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.319+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 shutdown_connections 2023-08-31T00:28:00.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.320+0000 7fd663b38700 1 -- 172.21.15.77:0/2299645233 wait complete. 2023-08-31T00:28:00.322 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-08-31T00:28:00.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T00:28:00.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.472+0000 7f717ccab700 1 -- 172.21.15.77:0/2350657555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71780ca4a0 msgr2=0x7f71780aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.472+0000 7f717ccab700 1 --2- 172.21.15.77:0/2350657555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71780ca4a0 0x7f71780aad30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7178071bd0 tx=0x7f7168009c70 comp rx=0 tx=0).stop 2023-08-31T00:28:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 -- 172.21.15.77:0/2350657555 shutdown_connections 2023-08-31T00:28:00.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 --2- 172.21.15.77:0/2350657555 >> v2:172.21.15.139:3300/0 conn(0x7f7178159460 0x7f7178069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 --2- 172.21.15.77:0/2350657555 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7178069b10 0x7f71780b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 --2- 172.21.15.77:0/2350657555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71780ca4a0 0x7f71780aad30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 -- 172.21.15.77:0/2350657555 >> 172.21.15.77:0/2350657555 conn(0x7f71780caca0 msgr2=0x7f71780cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:00.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 -- 172.21.15.77:0/2350657555 shutdown_connections 2023-08-31T00:28:00.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.473+0000 7f717ccab700 1 -- 172.21.15.77:0/2350657555 wait complete. 2023-08-31T00:28:00.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.474+0000 7f717ccab700 1 Processor -- start 2023-08-31T00:28:00.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.474+0000 7f717ccab700 1 -- start start 2023-08-31T00:28:00.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 0x7f71780c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:00.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71780ca4a0 0x7f7178143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:00.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7178159460 0x7f71780c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:00.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c6880 con 0x7f7178069b10 2023-08-31T00:28:00.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c6b60 con 0x7f7178159460 2023-08-31T00:28:00.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c6e40 con 0x7f71780ca4a0 2023-08-31T00:28:00.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 0x7f71780c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:00.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 0x7f71780c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40660/0 (socket says 172.21.15.77:40660) 2023-08-31T00:28:00.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 -- 172.21.15.77:0/3516481995 learned_addr learned my addr 172.21.15.77:0/3516481995 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:00.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f7175d9b700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71780ca4a0 0x7f7178143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:00.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f7176d9d700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7178159460 0x7f71780c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:00.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 -- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71780ca4a0 msgr2=0x7f7178143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:00.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71780ca4a0 0x7f7178143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 -- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7178159460 msgr2=0x7f71780c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:00.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7178159460 0x7f71780c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:00.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 -- 172.21.15.77:0/3516481995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680095f0 con 0x7f7178069b10 2023-08-31T00:28:00.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717659c700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 0x7f71780c7920 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f716c00d980 tx=0x7f716c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:00.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00f890 con 0x7f7178069b10 2023-08-31T00:28:00.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f716c00fae0 con 0x7f7178069b10 2023-08-31T00:28:00.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71780c7120 con 0x7f7178069b10 2023-08-31T00:28:00.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c010460 con 0x7f7178069b10 2023-08-31T00:28:00.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.475+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7178144090 con 0x7f7178069b10 2023-08-31T00:28:00.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.476+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71780668d0 con 0x7f7178069b10 2023-08-31T00:28:00.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.477+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f716c0105c0 con 0x7f7178069b10 2023-08-31T00:28:00.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.477+0000 7f7166ffd700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f715806a0e0 0x7f715806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:00.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.478+0000 7f7175d9b700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f715806a0e0 0x7f715806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:00.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.478+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f716c0883e0 con 0x7f7178069b10 2023-08-31T00:28:00.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.478+0000 7f7175d9b700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f715806a0e0 0x7f715806c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f71780ca8a0 tx=0x7f71680047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:00.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.482+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f716c053e30 con 0x7f7178069b10 2023-08-31T00:28:00.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:00.673+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7178073c30 con 0x7f7178069b10 2023-08-31T00:28:01.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.325+0000 7f7166ffd700 1 -- 172.21.15.77:0/3516481995 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f716c057450 con 0x7f7178069b10 2023-08-31T00:28:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.329+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f715806a0e0 msgr2=0x7f715806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.329+0000 7f717ccab700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f715806a0e0 0x7f715806c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f71780ca8a0 tx=0x7f71680047c0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.329+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 msgr2=0x7f71780c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:01.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.329+0000 7f717ccab700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 0x7f71780c7920 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f716c00d980 tx=0x7f716c00dc90 comp rx=0 tx=0).stop 2023-08-31T00:28:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.332+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 shutdown_connections 2023-08-31T00:28:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.332+0000 7f717ccab700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f715806a0e0 0x7f715806c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.332+0000 7f717ccab700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7178159460 0x7f71780c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.332+0000 7f717ccab700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7178069b10 0x7f71780c7920 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.332+0000 7f717ccab700 1 --2- 172.21.15.77:0/3516481995 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71780ca4a0 0x7f7178143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.332+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 >> 172.21.15.77:0/3516481995 conn(0x7f71780caca0 msgr2=0x7f717815b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:01.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.333+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 shutdown_connections 2023-08-31T00:28:01.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.334+0000 7f717ccab700 1 -- 172.21.15.77:0/3516481995 wait complete. 2023-08-31T00:28:01.339 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-08-31T00:28:01.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T00:28:01.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef7b20700 1 -- 172.21.15.77:0/1009200792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1edc003a00 msgr2=0x7f1edc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:01.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/1009200792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1edc003a00 0x7f1edc003e20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009be0 tx=0x7f1edc005880 comp rx=0 tx=0).stop 2023-08-31T00:28:01.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef60bd700 1 -- 172.21.15.77:0/1009200792 reap_dead start 2023-08-31T00:28:01.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef7b20700 1 -- 172.21.15.77:0/1009200792 shutdown_connections 2023-08-31T00:28:01.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef7b20700 1 -- 172.21.15.77:0/1009200792 >> 172.21.15.77:0/1009200792 conn(0x7f1ef006cbf0 msgr2=0x7f1ef006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:01.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef7b20700 1 -- 172.21.15.77:0/1009200792 shutdown_connections 2023-08-31T00:28:01.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.480+0000 7f1ef7b20700 1 -- 172.21.15.77:0/1009200792 wait complete. 2023-08-31T00:28:01.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.481+0000 7f1ef7b20700 1 Processor -- start 2023-08-31T00:28:01.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.481+0000 7f1ef7b20700 1 -- start start 2023-08-31T00:28:01.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef7b20700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1edc003a00 0x7f1ef015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:01.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef7b20700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ef01529d0 0x7f1ef00c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:01.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef7b20700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 0x7f1ef0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:01.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef7b20700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef015b690 con 0x7f1ef00c4120 2023-08-31T00:28:01.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef7b20700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00af270 con 0x7f1ef01529d0 2023-08-31T00:28:01.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef7b20700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef00c8160 con 0x7f1edc003a00 2023-08-31T00:28:01.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef60bd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 0x7f1ef0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:01.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef60bd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 0x7f1ef0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40684/0 (socket says 172.21.15.77:40684) 2023-08-31T00:28:01.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.482+0000 7f1ef60bd700 1 -- 172.21.15.77:0/2287093237 learned_addr learned my addr 172.21.15.77:0/2287093237 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:01.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef58bc700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1edc003a00 0x7f1ef015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:01.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef50bb700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ef01529d0 0x7f1ef00c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:01.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef60bd700 1 -- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1edc003a00 msgr2=0x7f1ef015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:01.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef60bd700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1edc003a00 0x7f1ef015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef60bd700 1 -- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ef01529d0 msgr2=0x7f1ef00c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:01.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef60bd700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ef01529d0 0x7f1ef00c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:01.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef60bd700 1 -- 172.21.15.77:0/2287093237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef01ee680 con 0x7f1ef00c4120 2023-08-31T00:28:01.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef60bd700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 0x7f1ef0151470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00cb890 tx=0x7f1ee8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:01.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012df0 con 0x7f1ef00c4120 2023-08-31T00:28:01.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ee8017070 con 0x7f1ef00c4120 2023-08-31T00:28:01.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef01ee8c0 con 0x7f1ef00c4120 2023-08-31T00:28:01.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee801e6c0 con 0x7f1ef00c4120 2023-08-31T00:28:01.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.483+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef01eee80 con 0x7f1ef00c4120 2023-08-31T00:28:01.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.484+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef00c45a0 con 0x7f1ef00c4120 2023-08-31T00:28:01.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.484+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ee801e820 con 0x7f1ef00c4120 2023-08-31T00:28:01.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.485+0000 7f1ee67fc700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1ed406a0e0 0x7f1ed406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:01.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.485+0000 7f1ef58bc700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1ed406a0e0 0x7f1ed406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:01.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.485+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1ee8019070 con 0x7f1ef00c4120 2023-08-31T00:28:01.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.485+0000 7f1ef58bc700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1ed406a0e0 0x7f1ed406c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009be0 tx=0x7f1eec004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:01.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.489+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1ee8056460 con 0x7f1ef00c4120 2023-08-31T00:28:01.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:01.724+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1ef01ee680 con 0x7f1ef00c4120 2023-08-31T00:28:02.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.345+0000 7f1ee67fc700 1 -- 172.21.15.77:0/2287093237 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1ef01ee680 con 0x7f1ef00c4120 2023-08-31T00:28:02.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1ed406a0e0 msgr2=0x7f1ed406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1ed406a0e0 0x7f1ed406c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009be0 tx=0x7f1eec004750 comp rx=0 tx=0).stop 2023-08-31T00:28:02.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 msgr2=0x7f1ef0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 0x7f1ef0151470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00cb890 tx=0x7f1ee8007f70 comp rx=0 tx=0).stop 2023-08-31T00:28:02.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 shutdown_connections 2023-08-31T00:28:02.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1ed406a0e0 0x7f1ed406c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1edc003a00 0x7f1ef015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ef00c4120 0x7f1ef0151470 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 --2- 172.21.15.77:0/2287093237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ef01529d0 0x7f1ef00c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 >> 172.21.15.77:0/2287093237 conn(0x7f1ef006cbf0 msgr2=0x7f1ef00c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:02.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 shutdown_connections 2023-08-31T00:28:02.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.354+0000 7f1ef7b20700 1 -- 172.21.15.77:0/2287093237 wait complete. 2023-08-31T00:28:02.361 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 4 and data pool 5 2023-08-31T00:28:02.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:28:02.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 -- 172.21.15.77:0/212054777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b501580f0 msgr2=0x7f3b500cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 --2- 172.21.15.77:0/212054777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b501580f0 0x7f3b500cc250 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005fd0 tx=0x7f3b44009c70 comp rx=0 tx=0).stop 2023-08-31T00:28:02.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 -- 172.21.15.77:0/212054777 shutdown_connections 2023-08-31T00:28:02.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 --2- 172.21.15.77:0/212054777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b501580f0 0x7f3b500cc250 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 --2- 172.21.15.77:0/212054777 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b5006f130 0x7f3b50070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 -- 172.21.15.77:0/212054777 >> 172.21.15.77:0/212054777 conn(0x7f3b5006cbf0 msgr2=0x7f3b5006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:02.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 -- 172.21.15.77:0/212054777 shutdown_connections 2023-08-31T00:28:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.497+0000 7f3b56b14700 1 -- 172.21.15.77:0/212054777 wait complete. 2023-08-31T00:28:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.498+0000 7f3b56b14700 1 Processor -- start 2023-08-31T00:28:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.498+0000 7f3b56b14700 1 -- start start 2023-08-31T00:28:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b56b14700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b5006f130 0x7f3b501f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b56b14700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 0x7f3b500c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b56b14700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b501580f0 0x7f3b500a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b56b14700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500c4590 con 0x7f3b50071000 2023-08-31T00:28:02.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b56b14700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500c57b0 con 0x7f3b5006f130 2023-08-31T00:28:02.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b56b14700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500a69a0 con 0x7f3b501580f0 2023-08-31T00:28:02.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 0x7f3b500c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 0x7f3b500c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40710/0 (socket says 172.21.15.77:40710) 2023-08-31T00:28:02.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 -- 172.21.15.77:0/735460755 learned_addr learned my addr 172.21.15.77:0/735460755 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:02.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 -- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b501580f0 msgr2=0x7f3b500a6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b550b1700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b501580f0 0x7f3b500a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b501580f0 0x7f3b500a6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 -- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b5006f130 msgr2=0x7f3b501f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b5006f130 0x7f3b501f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 -- 172.21.15.77:0/735460755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440095f0 con 0x7f3b50071000 2023-08-31T00:28:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.499+0000 7f3b4ffff700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 0x7f3b500c4050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d980 tx=0x7f3b3c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:02.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.500+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c009b40 con 0x7f3b50071000 2023-08-31T00:28:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.500+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b3c009d90 con 0x7f3b50071000 2023-08-31T00:28:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.500+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b500c8170 con 0x7f3b50071000 2023-08-31T00:28:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.500+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0106c0 con 0x7f3b50071000 2023-08-31T00:28:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.500+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b500c5d00 con 0x7f3b50071000 2023-08-31T00:28:02.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.501+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b500c5ec0 con 0x7f3b50071000 2023-08-31T00:28:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.501+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b3c010820 con 0x7f3b50071000 2023-08-31T00:28:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.502+0000 7f3b4d7fa700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3b3406a0e0 0x7f3b3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.502+0000 7f3b548b0700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3b3406a0e0 0x7f3b3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.502+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c088a30 con 0x7f3b50071000 2023-08-31T00:28:02.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.502+0000 7f3b548b0700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3b3406a0e0 0x7f3b3406c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b44004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:02.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.506+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b3c0542a0 con 0x7f3b50071000 2023-08-31T00:28:02.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.699+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b50073c30 con 0x7f3b50071000 2023-08-31T00:28:02.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.700+0000 7f3b4d7fa700 1 -- 172.21.15.77:0/735460755 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16570 (secure 0 0 0) 0x7f3b3c016090 con 0x7f3b50071000 2023-08-31T00:28:02.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":32,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:28:01.725839+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:27:59.679788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-08-31T00:28:00.692331+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:28:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3b3406a0e0 msgr2=0x7f3b3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3b3406a0e0 0x7f3b3406c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b44000c00 tx=0x7f3b44004750 comp rx=0 tx=0).stop 2023-08-31T00:28:02.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 msgr2=0x7f3b500c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 0x7f3b500c4050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d980 tx=0x7f3b3c00dd40 comp rx=0 tx=0).stop 2023-08-31T00:28:02.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 shutdown_connections 2023-08-31T00:28:02.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3b3406a0e0 0x7f3b3406c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b501580f0 0x7f3b500a6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b5006f130 0x7f3b501f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 --2- 172.21.15.77:0/735460755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b50071000 0x7f3b500c4050 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 >> 172.21.15.77:0/735460755 conn(0x7f3b5006cbf0 msgr2=0x7f3b500ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:02.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 shutdown_connections 2023-08-31T00:28:02.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.702+0000 7f3b56b14700 1 -- 172.21.15.77:0/735460755 wait complete. 2023-08-31T00:28:02.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:28:02.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f277e062700 1 -- 172.21.15.77:0/623514986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2760003fb0 msgr2=0x7f2760004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f277e062700 1 --2- 172.21.15.77:0/623514986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2760003fb0 0x7f2760004850 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f276c001720 tx=0x7f2760005880 comp rx=0 tx=0).stop 2023-08-31T00:28:02.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f2777fff700 1 -- 172.21.15.77:0/623514986 reap_dead start 2023-08-31T00:28:02.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f277e062700 1 -- 172.21.15.77:0/623514986 shutdown_connections 2023-08-31T00:28:02.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f277e062700 1 -- 172.21.15.77:0/623514986 >> 172.21.15.77:0/623514986 conn(0x7f2778071630 msgr2=0x7f2778071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:02.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f277e062700 1 -- 172.21.15.77:0/623514986 shutdown_connections 2023-08-31T00:28:02.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.837+0000 7f277e062700 1 -- 172.21.15.77:0/623514986 wait complete. 2023-08-31T00:28:02.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.838+0000 7f277e062700 1 Processor -- start 2023-08-31T00:28:02.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.839+0000 7f277e062700 1 -- start start 2023-08-31T00:28:02.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2760003fb0 0x7f277815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277814c7a0 0x7f27780b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 0x7f277815d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277815b9b0 con 0x7f27780b5780 2023-08-31T00:28:02.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27780b63d0 con 0x7f277814c7a0 2023-08-31T00:28:02.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277814cc20 con 0x7f2760003fb0 2023-08-31T00:28:02.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 0x7f277815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 0x7f277815d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40732/0 (socket says 172.21.15.77:40732) 2023-08-31T00:28:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 -- 172.21.15.77:0/813361562 learned_addr learned my addr 172.21.15.77:0/813361562 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f27777fe700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2760003fb0 0x7f277815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2776ffd700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277814c7a0 0x7f27780b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 -- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2760003fb0 msgr2=0x7f277815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2760003fb0 0x7f277815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 -- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277814c7a0 msgr2=0x7f27780b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277814c7a0 0x7f27780b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:02.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 -- 172.21.15.77:0/813361562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780b5d90 con 0x7f27780b5780 2023-08-31T00:28:02.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f2777fff700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 0x7f277815d380 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f27780cf0e0 tx=0x7f2770006610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:02.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770011870 con 0x7f27780b5780 2023-08-31T00:28:02.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2770011ac0 con 0x7f27780b5780 2023-08-31T00:28:02.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277815bc00 con 0x7f27780b5780 2023-08-31T00:28:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700103c0 con 0x7f27780b5780 2023-08-31T00:28:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.840+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277815c1c0 con 0x7f27780b5780 2023-08-31T00:28:02.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.841+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778073c30 con 0x7f27780b5780 2023-08-31T00:28:02.849 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.842+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2770010520 con 0x7f27780b5780 2023-08-31T00:28:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.842+0000 7f275ffff700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f276406a0e0 0x7f276406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.842+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2770088f30 con 0x7f27780b5780 2023-08-31T00:28:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.842+0000 7f27777fe700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f276406a0e0 0x7f276406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.842+0000 7f27777fe700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f276406a0e0 0x7f276406c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27781e6690 tx=0x7f2768009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:02.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:02.846+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2770054720 con 0x7f27780b5780 2023-08-31T00:28:03.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.037+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27780d11f0 con 0x7f27780b5780 2023-08-31T00:28:03.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.038+0000 7f275ffff700 1 -- 172.21.15.77:0/813361562 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16570 (secure 0 0 0) 0x7f2770015070 con 0x7f27780b5780 2023-08-31T00:28:03.039 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:03.039 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":32,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:28:01.725839+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:27:59.679788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-08-31T00:28:00.692331+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:28:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f276406a0e0 msgr2=0x7f276406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f276406a0e0 0x7f276406c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27781e6690 tx=0x7f2768009260 comp rx=0 tx=0).stop 2023-08-31T00:28:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 msgr2=0x7f277815d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:03.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 0x7f277815d380 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f27780cf0e0 tx=0x7f2770006610 comp rx=0 tx=0).stop 2023-08-31T00:28:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 shutdown_connections 2023-08-31T00:28:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f276406a0e0 0x7f276406c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2760003fb0 0x7f277815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f27780b5780 0x7f277815d380 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:03.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 --2- 172.21.15.77:0/813361562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f277814c7a0 0x7f27780b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 >> 172.21.15.77:0/813361562 conn(0x7f2778071630 msgr2=0x7f277815a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 shutdown_connections 2023-08-31T00:28:03.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.040+0000 7f277e062700 1 -- 172.21.15.77:0/813361562 wait complete. 2023-08-31T00:28:03.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T00:28:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46d521d700 1 -- 172.21.15.77:0/1069754617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b8004850 msgr2=0x7f46b8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46d521d700 1 --2- 172.21.15.77:0/1069754617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46b8004850 0x7f46b8004cd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c340 tx=0x7f46b8005880 comp rx=0 tx=0).stop 2023-08-31T00:28:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46cf59e700 1 -- 172.21.15.77:0/1069754617 reap_dead start 2023-08-31T00:28:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46d521d700 1 -- 172.21.15.77:0/1069754617 shutdown_connections 2023-08-31T00:28:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46d521d700 1 -- 172.21.15.77:0/1069754617 >> 172.21.15.77:0/1069754617 conn(0x7f46d0070270 msgr2=0x7f46d0070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46d521d700 1 -- 172.21.15.77:0/1069754617 shutdown_connections 2023-08-31T00:28:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.178+0000 7f46d521d700 1 -- 172.21.15.77:0/1069754617 wait complete. 2023-08-31T00:28:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.179+0000 7f46d521d700 1 Processor -- start 2023-08-31T00:28:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 -- start start 2023-08-31T00:28:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f46b8004850 0x7f46d00c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46d00c4920 0x7f46d00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 0x7f46d00aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00cbe70 con 0x7f46d00cb9f0 2023-08-31T00:28:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c5200 con 0x7f46d00c4920 2023-08-31T00:28:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46d521d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00c54e0 con 0x7f46b8004850 2023-08-31T00:28:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46cf59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 0x7f46d00aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46cf59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 0x7f46d00aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40752/0 (socket says 172.21.15.77:40752) 2023-08-31T00:28:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.180+0000 7f46cf59e700 1 -- 172.21.15.77:0/1020561376 learned_addr learned my addr 172.21.15.77:0/1020561376 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46ced9d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f46b8004850 0x7f46d00c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46ce59c700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46d00c4920 0x7f46d00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46cf59e700 1 -- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f46b8004850 msgr2=0x7f46d00c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46cf59e700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f46b8004850 0x7f46d00c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46cf59e700 1 -- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46d00c4920 msgr2=0x7f46d00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46cf59e700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46d00c4920 0x7f46d00cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46cf59e700 1 -- 172.21.15.77:0/1020561376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00c57c0 con 0x7f46d00cb9f0 2023-08-31T00:28:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46ced9d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f46b8004850 0x7f46d00c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46cf59e700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 0x7f46d00aba50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f46d00ac600 tx=0x7f46c80104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c800e070 con 0x7f46d00cb9f0 2023-08-31T00:28:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f46c800f040 con 0x7f46d00cb9f0 2023-08-31T00:28:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d00c5aa0 con 0x7f46d00cb9f0 2023-08-31T00:28:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8010c60 con 0x7f46d00cb9f0 2023-08-31T00:28:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.181+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d00c4da0 con 0x7f46d00cb9f0 2023-08-31T00:28:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.182+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d00c5fc0 con 0x7f46d00cb9f0 2023-08-31T00:28:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.182+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f46c8004030 con 0x7f46d00cb9f0 2023-08-31T00:28:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.183+0000 7f46b77fe700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f46bc06a110 0x7f46bc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:03.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.183+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46c8088a50 con 0x7f46d00cb9f0 2023-08-31T00:28:03.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.183+0000 7f46ced9d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f46bc06a110 0x7f46bc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:03.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.183+0000 7f46ced9d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f46bc06a110 0x7f46bc06c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009be0 tx=0x7f46c4009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:03.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.187+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f46d00c5fc0 con 0x7f46d00cb9f0 2023-08-31T00:28:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:03.423+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46d00c5fc0 con 0x7f46d00cb9f0 2023-08-31T00:28:04.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.343+0000 7f46b77fe700 1 -- 172.21.15.77:0/1020561376 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f46d00c5fc0 con 0x7f46d00cb9f0 2023-08-31T00:28:04.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f46bc06a110 msgr2=0x7f46bc06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:04.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f46bc06a110 0x7f46bc06c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009be0 tx=0x7f46c4009260 comp rx=0 tx=0).stop 2023-08-31T00:28:04.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 msgr2=0x7f46d00aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:04.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 0x7f46d00aba50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f46d00ac600 tx=0x7f46c80104a0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 shutdown_connections 2023-08-31T00:28:04.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f46bc06a110 0x7f46bc06c5d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f46b8004850 0x7f46d00c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46d00cb9f0 0x7f46d00aba50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 --2- 172.21.15.77:0/1020561376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46d00c4920 0x7f46d00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 >> 172.21.15.77:0/1020561376 conn(0x7f46d0070270 msgr2=0x7f46d0069ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:04.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 shutdown_connections 2023-08-31T00:28:04.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.346+0000 7f46d521d700 1 -- 172.21.15.77:0/1020561376 wait complete. 2023-08-31T00:28:04.362 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T00:28:04.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T00:28:04.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 -- 172.21.15.77:0/3623238453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 msgr2=0x7fb04415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:04.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 --2- 172.21.15.77:0/3623238453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb04415c8b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb034005fd0 tx=0x7fb034009c70 comp rx=0 tx=0).stop 2023-08-31T00:28:04.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 -- 172.21.15.77:0/3623238453 shutdown_connections 2023-08-31T00:28:04.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 --2- 172.21.15.77:0/3623238453 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb044070d90 0x7fb0440acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 --2- 172.21.15.77:0/3623238453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb04415c8b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 -- 172.21.15.77:0/3623238453 >> 172.21.15.77:0/3623238453 conn(0x7fb044070270 msgr2=0x7fb044070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:04.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 -- 172.21.15.77:0/3623238453 shutdown_connections 2023-08-31T00:28:04.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.494+0000 7fb04b833700 1 -- 172.21.15.77:0/3623238453 wait complete. 2023-08-31T00:28:04.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.495+0000 7fb04b833700 1 Processor -- start 2023-08-31T00:28:04.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.495+0000 7fb04b833700 1 -- start start 2023-08-31T00:28:04.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb04b833700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb0441546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:04.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb04b833700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb044070d90 0x7fb04406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:04.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb04b833700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb04415b730 0x7fb04406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:04.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb04b833700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c23d0 con 0x7fb04406b230 2023-08-31T00:28:04.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb04b833700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c2c30 con 0x7fb044070d90 2023-08-31T00:28:04.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb04b833700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0441ef1a0 con 0x7fb04415b730 2023-08-31T00:28:04.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb0441546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:04.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb0441546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40760/0 (socket says 172.21.15.77:40760) 2023-08-31T00:28:04.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 -- 172.21.15.77:0/2485257305 learned_addr learned my addr 172.21.15.77:0/2485257305 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:04.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb048dce700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb044070d90 0x7fb04406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:04.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb049dd0700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb04415b730 0x7fb04406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:04.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 -- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb04415b730 msgr2=0x7fb04406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:04.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb04415b730 0x7fb04406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 -- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb044070d90 msgr2=0x7fb04406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:04.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb044070d90 0x7fb04406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:04.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 -- 172.21.15.77:0/2485257305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340095f0 con 0x7fb04406b230 2023-08-31T00:28:04.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb048dce700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb044070d90 0x7fb04406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:04.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.496+0000 7fb0495cf700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb0441546e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb04000b4a0 tx=0x7fb04000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:04.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.497+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000f8a0 con 0x7fb04406b230 2023-08-31T00:28:04.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.497+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb04000faf0 con 0x7fb04406b230 2023-08-31T00:28:04.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.497+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040010470 con 0x7fb04406b230 2023-08-31T00:28:04.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.497+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0440c25e0 con 0x7fb04406b230 2023-08-31T00:28:04.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.497+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb044154c20 con 0x7fb04406b230 2023-08-31T00:28:04.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.498+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04415c8b0 con 0x7fb04406b230 2023-08-31T00:28:04.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.498+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb0400105d0 con 0x7fb04406b230 2023-08-31T00:28:04.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.498+0000 7fb039ffb700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb02806a0e0 0x7fb02806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:04.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.498+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb04008a060 con 0x7fb04406b230 2023-08-31T00:28:04.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.499+0000 7fb048dce700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb02806a0e0 0x7fb02806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:04.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.499+0000 7fb048dce700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb02806a0e0 0x7fb02806c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb034000c00 tx=0x7fb0340047c0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:04.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.503+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb040055840 con 0x7fb04406b230 2023-08-31T00:28:04.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:04.737+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb044073c30 con 0x7fb04406b230 2023-08-31T00:28:05.294 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-08-31T00:28:05.294+0000 7f6697ee4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T00:28:05.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.347+0000 7fb039ffb700 1 -- 172.21.15.77:0/2485257305 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb040058e60 con 0x7fb04406b230 2023-08-31T00:28:05.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb02806a0e0 msgr2=0x7fb02806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb02806a0e0 0x7fb02806c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb034000c00 tx=0x7fb0340047c0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 msgr2=0x7fb0441546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb0441546e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb04000b4a0 tx=0x7fb04000b860 comp rx=0 tx=0).stop 2023-08-31T00:28:05.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 shutdown_connections 2023-08-31T00:28:05.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fb02806a0e0 0x7fb02806c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb04415b730 0x7fb04406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb04406b230 0x7fb0441546e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 --2- 172.21.15.77:0/2485257305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb044070d90 0x7fb04406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 >> 172.21.15.77:0/2485257305 conn(0x7fb044070270 msgr2=0x7fb044069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:05.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 shutdown_connections 2023-08-31T00:28:05.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.350+0000 7fb04b833700 1 -- 172.21.15.77:0/2485257305 wait complete. 2023-08-31T00:28:05.365 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T00:28:05.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:28:05.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc967608700 1 -- 172.21.15.77:0/2733177885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc94c004d90 msgr2=0x7fc94c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc967608700 1 --2- 172.21.15.77:0/2733177885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc94c004d90 0x7fc94c005210 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ac600 tx=0x7fc94c005880 comp rx=0 tx=0).stop 2023-08-31T00:28:05.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc965ba5700 1 -- 172.21.15.77:0/2733177885 reap_dead start 2023-08-31T00:28:05.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc967608700 1 -- 172.21.15.77:0/2733177885 shutdown_connections 2023-08-31T00:28:05.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc967608700 1 -- 172.21.15.77:0/2733177885 >> 172.21.15.77:0/2733177885 conn(0x7fc960070270 msgr2=0x7fc960070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:05.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc967608700 1 -- 172.21.15.77:0/2733177885 shutdown_connections 2023-08-31T00:28:05.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.494+0000 7fc967608700 1 -- 172.21.15.77:0/2733177885 wait complete. 2023-08-31T00:28:05.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.495+0000 7fc967608700 1 Processor -- start 2023-08-31T00:28:05.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.495+0000 7fc967608700 1 -- start start 2023-08-31T00:28:05.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc967608700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 0x7fc96006d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc967608700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc96006dcb0 0x7fc960159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc967608700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc960159d90 0x7fc96015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc967608700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601f5ee0 con 0x7fc960159470 2023-08-31T00:28:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc967608700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96006e130 con 0x7fc96006dcb0 2023-08-31T00:28:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc967608700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9601f5120 con 0x7fc960159d90 2023-08-31T00:28:05.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 0x7fc96006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 0x7fc96006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40780/0 (socket says 172.21.15.77:40780) 2023-08-31T00:28:05.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 -- 172.21.15.77:0/2314310145 learned_addr learned my addr 172.21.15.77:0/2314310145 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:05.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc965ba5700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc960159d90 0x7fc96015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc964ba3700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc96006dcb0 0x7fc960159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 -- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc960159d90 msgr2=0x7fc96015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc960159d90 0x7fc96015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 -- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc96006dcb0 msgr2=0x7fc960159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc96006dcb0 0x7fc960159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc9653a4700 1 -- 172.21.15.77:0/2314310145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9601f5400 con 0x7fc960159470 2023-08-31T00:28:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc965ba5700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc960159d90 0x7fc96015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.496+0000 7fc964ba3700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc96006dcb0 0x7fc960159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.497+0000 7fc9653a4700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 0x7fc96006d770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc95000e930 tx=0x7fc95000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.497+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950004460 con 0x7fc960159470 2023-08-31T00:28:05.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.497+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc950003760 con 0x7fc960159470 2023-08-31T00:28:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.497+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500046b0 con 0x7fc960159470 2023-08-31T00:28:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.497+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9601f56e0 con 0x7fc960159470 2023-08-31T00:28:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.497+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9600cb420 con 0x7fc960159470 2023-08-31T00:28:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.498+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc960073c30 con 0x7fc960159470 2023-08-31T00:28:05.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.498+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc950003b50 con 0x7fc960159470 2023-08-31T00:28:05.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.498+0000 7fc955ffb700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a0e0 0x7fc94406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.498+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc950088b40 con 0x7fc960159470 2023-08-31T00:28:05.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.499+0000 7fc964ba3700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a0e0 0x7fc94406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.499+0000 7fc964ba3700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a0e0 0x7fc94406c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009c50 tx=0x7fc95c009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:05.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.503+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc9500543b0 con 0x7fc960159470 2023-08-31T00:28:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.737+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc960158960 con 0x7fc960159470 2023-08-31T00:28:05.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.738+0000 7fc955ffb700 1 -- 172.21.15.77:0/2314310145 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fc9500579d0 con 0x7fc960159470 2023-08-31T00:28:05.739 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:05.739 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/422218336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":422218336},{"type":"v1","addr":"172.21.15.139:6834","nonce":422218336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/613424595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":613424595},{"type":"v1","addr":"172.21.15.139:6835","nonce":613424595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2380301372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2380301372},{"type":"v1","addr":"172.21.15.77:6836","nonce":2380301372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:28:01.726150+0000","modified":"2023-08-31T00:28:05.343500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3392518749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3392518749},{"type":"v1","addr":"172.21.15.77:6837","nonce":3392518749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T00:28:05.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a0e0 msgr2=0x7fc94406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a0e0 0x7fc94406c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009c50 tx=0x7fc95c009260 comp rx=0 tx=0).stop 2023-08-31T00:28:05.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 msgr2=0x7fc96006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 0x7fc96006d770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc95000e930 tx=0x7fc95000ecf0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 shutdown_connections 2023-08-31T00:28:05.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fc94406a0e0 0x7fc94406c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc960159d90 0x7fc96015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc960159470 0x7fc96006d770 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 --2- 172.21.15.77:0/2314310145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc96006dcb0 0x7fc960159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 >> 172.21.15.77:0/2314310145 conn(0x7fc960070270 msgr2=0x7fc96006aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:05.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 shutdown_connections 2023-08-31T00:28:05.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.740+0000 7fc967608700 1 -- 172.21.15.77:0/2314310145 wait complete. 2023-08-31T00:28:05.745 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-08-31T00:28:05.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T00:28:05.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 -- 172.21.15.77:0/2794468613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed90005210 msgr2=0x7fed9000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 --2- 172.21.15.77:0/2794468613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed90005210 0x7fed9000ba10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00e320 tx=0x7fed90005880 comp rx=0 tx=0).stop 2023-08-31T00:28:05.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 -- 172.21.15.77:0/2794468613 shutdown_connections 2023-08-31T00:28:05.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 --2- 172.21.15.77:0/2794468613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed90005210 0x7fed9000ba10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 -- 172.21.15.77:0/2794468613 >> 172.21.15.77:0/2794468613 conn(0x7feda406cbf0 msgr2=0x7feda406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:05.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 -- 172.21.15.77:0/2794468613 shutdown_connections 2023-08-31T00:28:05.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.876+0000 7fedac69a700 1 -- 172.21.15.77:0/2794468613 wait complete. 2023-08-31T00:28:05.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.877+0000 7fedac69a700 1 Processor -- start 2023-08-31T00:28:05.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.877+0000 7fedac69a700 1 -- start start 2023-08-31T00:28:05.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedac69a700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fed90005210 0x7feda40c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedac69a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feda4144fe0 0x7feda40c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedac69a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 0x7feda40c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedac69a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40c2380 con 0x7feda40c4890 2023-08-31T00:28:05.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedac69a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40c3830 con 0x7feda4144fe0 2023-08-31T00:28:05.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedac69a700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40c3ad0 con 0x7fed90005210 2023-08-31T00:28:05.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 0x7feda40c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 0x7feda40c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40804/0 (socket says 172.21.15.77:40804) 2023-08-31T00:28:05.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 -- 172.21.15.77:0/1336827367 learned_addr learned my addr 172.21.15.77:0/1336827367 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:05.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaa436700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fed90005210 0x7feda40c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7feda9c35700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feda4144fe0 0x7feda40c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 -- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fed90005210 msgr2=0x7feda40c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fed90005210 0x7feda40c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 -- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feda4144fe0 msgr2=0x7feda40c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:05.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feda4144fe0 0x7feda40c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:05.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 -- 172.21.15.77:0/1336827367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40c3db0 con 0x7feda40c4890 2023-08-31T00:28:05.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7feda9c35700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feda4144fe0 0x7feda40c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:05.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.878+0000 7fedaac37700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 0x7feda40c7300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feda40cb650 tx=0x7fed9c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:05.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.879+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c003c00 con 0x7feda40c4890 2023-08-31T00:28:05.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.879+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed9c003da0 con 0x7feda40c4890 2023-08-31T00:28:05.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.879+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40c4090 con 0x7feda40c4890 2023-08-31T00:28:05.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.879+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c007760 con 0x7feda40c4890 2023-08-31T00:28:05.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.879+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40c2090 con 0x7feda40c4890 2023-08-31T00:28:05.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.880+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda40c45b0 con 0x7feda40c4890 2023-08-31T00:28:05.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.880+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fed9c0078c0 con 0x7feda40c4890 2023-08-31T00:28:05.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.880+0000 7fed9affd700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fed8806a110 0x7fed8806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:05.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.881+0000 7fedaa436700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fed8806a110 0x7fed8806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:05.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.881+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed9c088920 con 0x7feda40c4890 2023-08-31T00:28:05.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.881+0000 7fedaa436700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fed8806a110 0x7fed8806c5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed94001c10 tx=0x7fed94001ba0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:05.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:05.885+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feda40c45b0 con 0x7feda40c4890 2023-08-31T00:28:06.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.076+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feda40c45b0 con 0x7feda40c4890 2023-08-31T00:28:06.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.077+0000 7fed9affd700 1 -- 172.21.15.77:0/1336827367 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16557 (secure 0 0 0) 0x7feda40c45b0 con 0x7feda40c4890 2023-08-31T00:28:06.078 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:06.078 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","created":"2023-08-31T00:26:33.460009+0000","modified":"2023-08-31T00:28:03.322942+0000","last_up_change":"2023-08-31T00:26:46.090753+0000","last_in_change":"2023-08-31T00:26:37.028623+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T00:26:46.157659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-08-31T00:27:59.679788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-08-31T00:28:00.692331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f8ee97c-b0be-408c-acbd-36ef632ab102","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6801","nonce":1182377671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6803","nonce":1182377671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6807","nonce":1182377671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1182377671},{"type":"v1","addr":"172.21.15.77:6805","nonce":1182377671}]},"public_addr":"172.21.15.77:6801/1182377671","cluster_addr":"172.21.15.77:6803/1182377671","heartbeat_back_addr":"172.21.15.77:6807/1182377671","heartbeat_front_addr":"172.21.15.77:6805/1182377671","state":["exists","up"]},{"osd":1,"uuid":"bf8126e9-6a74-4f00-ab1c-01bf3f975132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6825","nonce":1504479232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6827","nonce":1504479232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6831","nonce":1504479232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1504479232},{"type":"v1","addr":"172.21.15.77:6829","nonce":1504479232}]},"public_addr":"172.21.15.77:6825/1504479232","cluster_addr":"172.21.15.77:6827/1504479232","heartbeat_back_addr":"172.21.15.77:6831/1504479232","heartbeat_front_addr":"172.21.15.77:6829/1504479232","state":["exists","up"]},{"osd":2,"uuid":"bd3a1316-bda1-4a58-987b-dbe23924bb84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6810","nonce":2822151791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6813","nonce":2822151791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6820","nonce":2822151791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":2822151791},{"type":"v1","addr":"172.21.15.77:6817","nonce":2822151791}]},"public_addr":"172.21.15.77:6810/2822151791","cluster_addr":"172.21.15.77:6813/2822151791","heartbeat_back_addr":"172.21.15.77:6820/2822151791","heartbeat_front_addr":"172.21.15.77:6817/2822151791","state":["exists","up"]},{"osd":3,"uuid":"3e2033da-1071-4e72-a025-6cee65b2ccd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6811","nonce":2481662276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6816","nonce":2481662276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6823","nonce":2481662276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6819","nonce":2481662276},{"type":"v1","addr":"172.21.15.77:6821","nonce":2481662276}]},"public_addr":"172.21.15.77:6811/2481662276","cluster_addr":"172.21.15.77:6816/2481662276","heartbeat_back_addr":"172.21.15.77:6823/2481662276","heartbeat_front_addr":"172.21.15.77:6821/2481662276","state":["exists","up"]},{"osd":4,"uuid":"5ff85074-9341-45ce-91e2-90ca00e5647e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6801","nonce":285884193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6803","nonce":285884193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6807","nonce":285884193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":285884193},{"type":"v1","addr":"172.21.15.139:6805","nonce":285884193}]},"public_addr":"172.21.15.139:6801/285884193","cluster_addr":"172.21.15.139:6803/285884193","heartbeat_back_addr":"172.21.15.139:6807/285884193","heartbeat_front_addr":"172.21.15.139:6805/285884193","state":["exists","up"]},{"osd":5,"uuid":"4ec98b50-71ba-406d-a442-552ca3d6cd4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6809","nonce":3613649331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6811","nonce":3613649331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6815","nonce":3613649331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3613649331},{"type":"v1","addr":"172.21.15.139:6813","nonce":3613649331}]},"public_addr":"172.21.15.139:6809/3613649331","cluster_addr":"172.21.15.139:6811/3613649331","heartbeat_back_addr":"172.21.15.139:6815/3613649331","heartbeat_front_addr":"172.21.15.139:6813/3613649331","state":["exists","up"]},{"osd":6,"uuid":"92ef0b62-f829-4063-a00b-b92da3625246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6825","nonce":2255490164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6827","nonce":2255490164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6831","nonce":2255490164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2255490164},{"type":"v1","addr":"172.21.15.139:6829","nonce":2255490164}]},"public_addr":"172.21.15.139:6825/2255490164","cluster_addr":"172.21.15.139:6827/2255490164","heartbeat_back_addr":"172.21.15.139:6831/2255490164","heartbeat_front_addr":"172.21.15.139:6829/2255490164","state":["exists","up"]},{"osd":7,"uuid":"c9ac674a-e1db-4d1d-b283-c9368e152feb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6817","nonce":926809794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6819","nonce":926809794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6823","nonce":926809794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":926809794},{"type":"v1","addr":"172.21.15.139:6821","nonce":926809794}]},"public_addr":"172.21.15.139:6817/926809794","cluster_addr":"172.21.15.139:6819/926809794","heartbeat_back_addr":"172.21.15.139:6823/926809794","heartbeat_front_addr":"172.21.15.139:6821/926809794","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.217455+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.268825+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.208517+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.214941+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.164300+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.154692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.206501+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T00:26:42.225790+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T00:28:06.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fed8806a110 msgr2=0x7fed8806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fed8806a110 0x7fed8806c5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed94001c10 tx=0x7fed94001ba0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 msgr2=0x7feda40c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 0x7feda40c7300 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feda40cb650 tx=0x7fed9c0093b0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 shutdown_connections 2023-08-31T00:28:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fed8806a110 0x7fed8806c5d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fed90005210 0x7feda40c0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda40c4890 0x7feda40c7300 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 --2- 172.21.15.77:0/1336827367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feda4144fe0 0x7feda40c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.079+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 >> 172.21.15.77:0/1336827367 conn(0x7feda406cbf0 msgr2=0x7feda4158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.080+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 shutdown_connections 2023-08-31T00:28:06.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.080+0000 7fedac69a700 1 -- 172.21.15.77:0/1336827367 wait complete. 2023-08-31T00:28:06.092 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T00:28:06.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:28:06.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 -- 172.21.15.77:0/922836672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06e6e0 msgr2=0x7f932c06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 --2- 172.21.15.77:0/922836672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06e6e0 0x7f932c06ab20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f931c009990 tx=0x7f931c009ca0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 -- 172.21.15.77:0/922836672 shutdown_connections 2023-08-31T00:28:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 --2- 172.21.15.77:0/922836672 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f932c06b060 0x7f932c0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 --2- 172.21.15.77:0/922836672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06e6e0 0x7f932c06ab20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 -- 172.21.15.77:0/922836672 >> 172.21.15.77:0/922836672 conn(0x7f932c070270 msgr2=0x7f932c070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:06.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 -- 172.21.15.77:0/922836672 shutdown_connections 2023-08-31T00:28:06.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.215+0000 7f9332085700 1 -- 172.21.15.77:0/922836672 wait complete. 2023-08-31T00:28:06.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.216+0000 7f9332085700 1 Processor -- start 2023-08-31T00:28:06.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 -- start start 2023-08-31T00:28:06.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 0x7f932c1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f932c06e6e0 0x7f932c1e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f932c0ace10 0x7f932c1e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c15acd0 con 0x7f932c06b060 2023-08-31T00:28:06.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c15a0c0 con 0x7f932c06e6e0 2023-08-31T00:28:06.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.217+0000 7f9332085700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c15a3a0 con 0x7f932c0ace10 2023-08-31T00:28:06.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 0x7f932c1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 0x7f932c1f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40814/0 (socket says 172.21.15.77:40814) 2023-08-31T00:28:06.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 -- 172.21.15.77:0/4227975226 learned_addr learned my addr 172.21.15.77:0/4227975226 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:06.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932bfff700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f932c0ace10 0x7f932c1e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 -- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f932c0ace10 msgr2=0x7f932c1e20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f932c0ace10 0x7f932c1e20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 -- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f932c06e6e0 msgr2=0x7f932c1e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f932c06e6e0 0x7f932c1e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 -- 172.21.15.77:0/4227975226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0095f0 con 0x7f932c06b060 2023-08-31T00:28:06.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f932b7fe700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 0x7f932c1f29f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f932000c430 tx=0x7f932000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:06.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200052d0 con 0x7f932c06b060 2023-08-31T00:28:06.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9320005540 con 0x7f932c06b060 2023-08-31T00:28:06.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c15a680 con 0x7f932c06b060 2023-08-31T00:28:06.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320006aa0 con 0x7f932c06b060 2023-08-31T00:28:06.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.218+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c0c2d70 con 0x7f932c06b060 2023-08-31T00:28:06.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.219+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c073c30 con 0x7f932c06b060 2023-08-31T00:28:06.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.220+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9320003680 con 0x7f932c06b060 2023-08-31T00:28:06.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.220+0000 7f9313fff700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f931806a0e0 0x7f931806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.220+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9320087900 con 0x7f932c06b060 2023-08-31T00:28:06.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.220+0000 7f932affd700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f931806a0e0 0x7f931806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.221+0000 7f932affd700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f931806a0e0 0x7f931806c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f932c06af40 tx=0x7f931c004750 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:06.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.224+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93200530e0 con 0x7f932c06b060 2023-08-31T00:28:06.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.413+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f932c0cbde0 con 0x7f931806a0e0 2023-08-31T00:28:06.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.421+0000 7f9313fff700 1 -- 172.21.15.77:0/4227975226 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276996 (secure 0 0 0) 0x7f931c004030 con 0x7f931806a0e0 2023-08-31T00:28:06.425 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f931806a0e0 msgr2=0x7f931806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f931806a0e0 0x7f931806c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f932c06af40 tx=0x7f931c004750 comp rx=0 tx=0).stop 2023-08-31T00:28:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 msgr2=0x7f932c1f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 0x7f932c1f29f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f932000c430 tx=0x7f932000c7f0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 shutdown_connections 2023-08-31T00:28:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f931806a0e0 0x7f931806c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f932c0ace10 0x7f932c1e20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f932c06b060 0x7f932c1f29f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 --2- 172.21.15.77:0/4227975226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f932c06e6e0 0x7f932c1e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 >> 172.21.15.77:0/4227975226 conn(0x7f932c070270 msgr2=0x7f932c070650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 shutdown_connections 2023-08-31T00:28:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.424+0000 7f9332085700 1 -- 172.21.15.77:0/4227975226 wait complete. 2023-08-31T00:28:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:28:06.437 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-08-31T00:28:06.129951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3748,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3837952,"data_stored":2183973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.818043"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319730+0000","last_change":"2023-08-31T00:28:00.319730+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319730+0000","last_undegraded":"2023-08-31T00:28:00.319730+0000","last_fullsized":"2023-08-31T00:28:00.319730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316805+0000","last_change":"2023-08-31T00:28:00.316805+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316805+0000","last_undegraded":"2023-08-31T00:28:00.316805+0000","last_fullsized":"2023-08-31T00:28:00.316805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319999+0000","last_change":"2023-08-31T00:28:00.319999+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319999+0000","last_undegraded":"2023-08-31T00:28:00.319999+0000","last_fullsized":"2023-08-31T00:28:00.319999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.322676+0000","last_change":"2023-08-31T00:28:00.322676+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.322676+0000","last_undegraded":"2023-08-31T00:28:00.322676+0000","last_fullsized":"2023-08-31T00:28:00.322676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.321384+0000","last_change":"2023-08-31T00:28:00.321384+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.321384+0000","last_undegraded":"2023-08-31T00:28:00.321384+0000","last_fullsized":"2023-08-31T00:28:00.321384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320547+0000","last_change":"2023-08-31T00:28:00.320547+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320547+0000","last_undegraded":"2023-08-31T00:28:00.320547+0000","last_fullsized":"2023-08-31T00:28:00.320547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319401+0000","last_change":"2023-08-31T00:28:00.319401+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319401+0000","last_undegraded":"2023-08-31T00:28:00.319401+0000","last_fullsized":"2023-08-31T00:28:00.319401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319171+0000","last_change":"2023-08-31T00:28:00.319171+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319171+0000","last_undegraded":"2023-08-31T00:28:00.319171+0000","last_fullsized":"2023-08-31T00:28:00.319171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319120+0000","last_change":"2023-08-31T00:28:00.319120+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319120+0000","last_undegraded":"2023-08-31T00:28:00.319120+0000","last_fullsized":"2023-08-31T00:28:00.319120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316262+0000","last_change":"2023-08-31T00:28:00.316262+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316262+0000","last_undegraded":"2023-08-31T00:28:00.316262+0000","last_fullsized":"2023-08-31T00:28:00.316262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.317969+0000","last_change":"2023-08-31T00:28:00.317969+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.317969+0000","last_undegraded":"2023-08-31T00:28:00.317969+0000","last_fullsized":"2023-08-31T00:28:00.317969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319574+0000","last_change":"2023-08-31T00:28:00.319574+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319574+0000","last_undegraded":"2023-08-31T00:28:00.319574+0000","last_fullsized":"2023-08-31T00:28:00.319574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320876+0000","last_change":"2023-08-31T00:28:00.320876+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320876+0000","last_undegraded":"2023-08-31T00:28:00.320876+0000","last_fullsized":"2023-08-31T00:28:00.320876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319109+0000","last_change":"2023-08-31T00:28:00.319109+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319109+0000","last_undegraded":"2023-08-31T00:28:00.319109+0000","last_fullsized":"2023-08-31T00:28:00.319109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318701+0000","last_change":"2023-08-31T00:28:00.318701+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318701+0000","last_undegraded":"2023-08-31T00:28:00.318701+0000","last_fullsized":"2023-08-31T00:28:00.318701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319126+0000","last_change":"2023-08-31T00:28:00.319126+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319126+0000","last_undegraded":"2023-08-31T00:28:00.319126+0000","last_fullsized":"2023-08-31T00:28:00.319126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319341+0000","last_change":"2023-08-31T00:28:00.319341+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319341+0000","last_undegraded":"2023-08-31T00:28:00.319341+0000","last_fullsized":"2023-08-31T00:28:00.319341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320652+0000","last_change":"2023-08-31T00:28:00.320652+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320652+0000","last_undegraded":"2023-08-31T00:28:00.320652+0000","last_fullsized":"2023-08-31T00:28:00.320652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320523+0000","last_change":"2023-08-31T00:28:00.320523+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320523+0000","last_undegraded":"2023-08-31T00:28:00.320523+0000","last_fullsized":"2023-08-31T00:28:00.320523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319067+0000","last_change":"2023-08-31T00:28:00.319067+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319067+0000","last_undegraded":"2023-08-31T00:28:00.319067+0000","last_fullsized":"2023-08-31T00:28:00.319067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316222+0000","last_change":"2023-08-31T00:28:00.316222+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316222+0000","last_undegraded":"2023-08-31T00:28:00.316222+0000","last_fullsized":"2023-08-31T00:28:00.316222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319045+0000","last_change":"2023-08-31T00:28:00.319045+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319045+0000","last_undegraded":"2023-08-31T00:28:00.319045+0000","last_fullsized":"2023-08-31T00:28:00.319045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320899+0000","last_change":"2023-08-31T00:28:00.320899+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320899+0000","last_undegraded":"2023-08-31T00:28:00.320899+0000","last_fullsized":"2023-08-31T00:28:00.320899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318014+0000","last_change":"2023-08-31T00:28:00.318014+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318014+0000","last_undegraded":"2023-08-31T00:28:00.318014+0000","last_fullsized":"2023-08-31T00:28:00.318014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318757+0000","last_change":"2023-08-31T00:28:00.318757+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318757+0000","last_undegraded":"2023-08-31T00:28:00.318757+0000","last_fullsized":"2023-08-31T00:28:00.318757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315539+0000","last_change":"2023-08-31T00:28:00.315539+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315539+0000","last_undegraded":"2023-08-31T00:28:00.315539+0000","last_fullsized":"2023-08-31T00:28:00.315539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318710+0000","last_change":"2023-08-31T00:28:00.318710+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318710+0000","last_undegraded":"2023-08-31T00:28:00.318710+0000","last_fullsized":"2023-08-31T00:28:00.318710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315524+0000","last_change":"2023-08-31T00:28:00.315524+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315524+0000","last_undegraded":"2023-08-31T00:28:00.315524+0000","last_fullsized":"2023-08-31T00:28:00.315524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318659+0000","last_change":"2023-08-31T00:28:00.318659+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318659+0000","last_undegraded":"2023-08-31T00:28:00.318659+0000","last_fullsized":"2023-08-31T00:28:00.318659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319326+0000","last_change":"2023-08-31T00:28:00.319326+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319326+0000","last_undegraded":"2023-08-31T00:28:00.319326+0000","last_fullsized":"2023-08-31T00:28:00.319326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318624+0000","last_change":"2023-08-31T00:28:00.318624+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318624+0000","last_undegraded":"2023-08-31T00:28:00.318624+0000","last_fullsized":"2023-08-31T00:28:00.318624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319027+0000","last_change":"2023-08-31T00:28:00.319027+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319027+0000","last_undegraded":"2023-08-31T00:28:00.319027+0000","last_fullsized":"2023-08-31T00:28:00.319027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T00:27:55.360924+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:27:55.360924+0000","last_peered":"2023-08-31T00:27:55.360924+0000","last_clean":"2023-08-31T00:27:55.360924+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:27:55.360924+0000","last_undegraded":"2023-08-31T00:27:55.360924+0000","last_fullsized":"2023-08-31T00:27:55.360924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.501}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.626}]},{"osd":3,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":712137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.374},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.0579999999999998,"5min":7.0579999999999998,"15min":7.0579999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":7.0229999999999997,"5min":7.0229999999999997,"15min":7.0229999999999997},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":12.702999999999999,"5min":12.702999999999999,"15min":12.702999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":7.2309999999999999,"5min":7.2309999999999999,"15min":7.2309999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.6909999999999998,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.371},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":12.811999999999999,"5min":12.811999999999999,"15min":12.811999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":12.756,"5min":12.756,"15min":12.756},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":12.785,"5min":12.785,"15min":12.785},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.308},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.434}]},{"osd":3,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0540000000000003,"5min":4.0540000000000003,"15min":4.0540000000000003},"last":0.627},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.6180000000000003,"5min":4.6180000000000003,"15min":4.6180000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.375},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":16.422999999999998,"5min":16.422999999999998,"15min":16.422999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:28:06.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:28:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f2319778700 1 -- 172.21.15.77:0/1245266780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 msgr2=0x7f22fc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f2319778700 1 --2- 172.21.15.77:0/1245266780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f22fc004850 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f230400c310 tx=0x7f22fc005880 comp rx=0 tx=0).stop 2023-08-31T00:28:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f23137fe700 1 -- 172.21.15.77:0/1245266780 reap_dead start 2023-08-31T00:28:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f2319778700 1 -- 172.21.15.77:0/1245266780 shutdown_connections 2023-08-31T00:28:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f2319778700 1 -- 172.21.15.77:0/1245266780 >> 172.21.15.77:0/1245266780 conn(0x7f2314071630 msgr2=0x7f2314071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:06.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f2319778700 1 -- 172.21.15.77:0/1245266780 shutdown_connections 2023-08-31T00:28:06.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.600+0000 7f2319778700 1 -- 172.21.15.77:0/1245266780 wait complete. 2023-08-31T00:28:06.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.601+0000 7f2319778700 1 Processor -- start 2023-08-31T00:28:06.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.601+0000 7f2319778700 1 -- start start 2023-08-31T00:28:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2319778700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f231414ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2319778700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23140b4c60 0x7f23140b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2319778700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2314161160 0x7f23141615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2319778700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140b5620 con 0x7f22fc003fb0 2023-08-31T00:28:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2319778700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23141621c0 con 0x7f23140b4c60 2023-08-31T00:28:06.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2319778700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231414d390 con 0x7f2314161160 2023-08-31T00:28:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f231414ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f231414ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40834/0 (socket says 172.21.15.77:40834) 2023-08-31T00:28:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 -- 172.21.15.77:0/4170836415 learned_addr learned my addr 172.21.15.77:0/4170836415 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f23127fc700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23140b4c60 0x7f23140b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f23137fe700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2314161160 0x7f23141615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 -- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2314161160 msgr2=0x7f23141615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2314161160 0x7f23141615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 -- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23140b4c60 msgr2=0x7f23140b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23140b4c60 0x7f23140b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f2312ffd700 1 -- 172.21.15.77:0/4170836415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314161ee0 con 0x7f22fc003fb0 2023-08-31T00:28:06.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f23137fe700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2314161160 0x7f23141615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:06.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.602+0000 7f23127fc700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23140b4c60 0x7f23140b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.603+0000 7f2312ffd700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f231414ce50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2308003f70 tx=0x7f23080015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.603+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080061b0 con 0x7f22fc003fb0 2023-08-31T00:28:06.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.603+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2308011430 con 0x7f22fc003fb0 2023-08-31T00:28:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.603+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2314154a70 con 0x7f22fc003fb0 2023-08-31T00:28:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.603+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308011820 con 0x7f22fc003fb0 2023-08-31T00:28:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.603+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2314155030 con 0x7f22fc003fb0 2023-08-31T00:28:06.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.604+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23141548d0 con 0x7f22fc003fb0 2023-08-31T00:28:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.604+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2308011b90 con 0x7f22fc003fb0 2023-08-31T00:28:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.605+0000 7f22fb7fe700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f230006a0e0 0x7f230006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.605+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2308089420 con 0x7f22fc003fb0 2023-08-31T00:28:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.605+0000 7f23127fc700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f230006a0e0 0x7f230006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.605+0000 7f23127fc700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f230006a0e0 0x7f230006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f231415e860 tx=0x7f230400f000 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.609+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23141548d0 con 0x7f22fc003fb0 2023-08-31T00:28:06.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.796+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2314164080 con 0x7f230006a0e0 2023-08-31T00:28:06.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.803+0000 7f22fb7fe700 1 -- 172.21.15.77:0/4170836415 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276996 (secure 0 0 0) 0x7f230400ccb0 con 0x7f230006a0e0 2023-08-31T00:28:06.806 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:06.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f230006a0e0 msgr2=0x7f230006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f230006a0e0 0x7f230006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f231415e860 tx=0x7f230400f000 comp rx=0 tx=0).stop 2023-08-31T00:28:06.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 msgr2=0x7f231414ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f231414ce50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2308003f70 tx=0x7f23080015f0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 shutdown_connections 2023-08-31T00:28:06.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f230006a0e0 0x7f230006c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f2314161160 0x7f23141615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22fc003fb0 0x7f231414ce50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 --2- 172.21.15.77:0/4170836415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23140b4c60 0x7f23140b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 >> 172.21.15.77:0/4170836415 conn(0x7f2314071630 msgr2=0x7f23140b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:06.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 shutdown_connections 2023-08-31T00:28:06.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.806+0000 7f2319778700 1 -- 172.21.15.77:0/4170836415 wait complete. 2023-08-31T00:28:06.811 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:28:06.819 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-08-31T00:28:06.129951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3748,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3837952,"data_stored":2183973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.818043"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319730+0000","last_change":"2023-08-31T00:28:00.319730+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319730+0000","last_undegraded":"2023-08-31T00:28:00.319730+0000","last_fullsized":"2023-08-31T00:28:00.319730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316805+0000","last_change":"2023-08-31T00:28:00.316805+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316805+0000","last_undegraded":"2023-08-31T00:28:00.316805+0000","last_fullsized":"2023-08-31T00:28:00.316805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319999+0000","last_change":"2023-08-31T00:28:00.319999+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319999+0000","last_undegraded":"2023-08-31T00:28:00.319999+0000","last_fullsized":"2023-08-31T00:28:00.319999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.322676+0000","last_change":"2023-08-31T00:28:00.322676+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.322676+0000","last_undegraded":"2023-08-31T00:28:00.322676+0000","last_fullsized":"2023-08-31T00:28:00.322676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.321384+0000","last_change":"2023-08-31T00:28:00.321384+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.321384+0000","last_undegraded":"2023-08-31T00:28:00.321384+0000","last_fullsized":"2023-08-31T00:28:00.321384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320547+0000","last_change":"2023-08-31T00:28:00.320547+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320547+0000","last_undegraded":"2023-08-31T00:28:00.320547+0000","last_fullsized":"2023-08-31T00:28:00.320547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319401+0000","last_change":"2023-08-31T00:28:00.319401+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319401+0000","last_undegraded":"2023-08-31T00:28:00.319401+0000","last_fullsized":"2023-08-31T00:28:00.319401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319171+0000","last_change":"2023-08-31T00:28:00.319171+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319171+0000","last_undegraded":"2023-08-31T00:28:00.319171+0000","last_fullsized":"2023-08-31T00:28:00.319171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319120+0000","last_change":"2023-08-31T00:28:00.319120+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319120+0000","last_undegraded":"2023-08-31T00:28:00.319120+0000","last_fullsized":"2023-08-31T00:28:00.319120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316262+0000","last_change":"2023-08-31T00:28:00.316262+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316262+0000","last_undegraded":"2023-08-31T00:28:00.316262+0000","last_fullsized":"2023-08-31T00:28:00.316262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.317969+0000","last_change":"2023-08-31T00:28:00.317969+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.317969+0000","last_undegraded":"2023-08-31T00:28:00.317969+0000","last_fullsized":"2023-08-31T00:28:00.317969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319574+0000","last_change":"2023-08-31T00:28:00.319574+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319574+0000","last_undegraded":"2023-08-31T00:28:00.319574+0000","last_fullsized":"2023-08-31T00:28:00.319574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320876+0000","last_change":"2023-08-31T00:28:00.320876+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320876+0000","last_undegraded":"2023-08-31T00:28:00.320876+0000","last_fullsized":"2023-08-31T00:28:00.320876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319109+0000","last_change":"2023-08-31T00:28:00.319109+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319109+0000","last_undegraded":"2023-08-31T00:28:00.319109+0000","last_fullsized":"2023-08-31T00:28:00.319109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318701+0000","last_change":"2023-08-31T00:28:00.318701+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318701+0000","last_undegraded":"2023-08-31T00:28:00.318701+0000","last_fullsized":"2023-08-31T00:28:00.318701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319126+0000","last_change":"2023-08-31T00:28:00.319126+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319126+0000","last_undegraded":"2023-08-31T00:28:00.319126+0000","last_fullsized":"2023-08-31T00:28:00.319126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319341+0000","last_change":"2023-08-31T00:28:00.319341+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319341+0000","last_undegraded":"2023-08-31T00:28:00.319341+0000","last_fullsized":"2023-08-31T00:28:00.319341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320652+0000","last_change":"2023-08-31T00:28:00.320652+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320652+0000","last_undegraded":"2023-08-31T00:28:00.320652+0000","last_fullsized":"2023-08-31T00:28:00.320652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320523+0000","last_change":"2023-08-31T00:28:00.320523+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320523+0000","last_undegraded":"2023-08-31T00:28:00.320523+0000","last_fullsized":"2023-08-31T00:28:00.320523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319067+0000","last_change":"2023-08-31T00:28:00.319067+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319067+0000","last_undegraded":"2023-08-31T00:28:00.319067+0000","last_fullsized":"2023-08-31T00:28:00.319067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316222+0000","last_change":"2023-08-31T00:28:00.316222+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316222+0000","last_undegraded":"2023-08-31T00:28:00.316222+0000","last_fullsized":"2023-08-31T00:28:00.316222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319045+0000","last_change":"2023-08-31T00:28:00.319045+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319045+0000","last_undegraded":"2023-08-31T00:28:00.319045+0000","last_fullsized":"2023-08-31T00:28:00.319045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320899+0000","last_change":"2023-08-31T00:28:00.320899+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320899+0000","last_undegraded":"2023-08-31T00:28:00.320899+0000","last_fullsized":"2023-08-31T00:28:00.320899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318014+0000","last_change":"2023-08-31T00:28:00.318014+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318014+0000","last_undegraded":"2023-08-31T00:28:00.318014+0000","last_fullsized":"2023-08-31T00:28:00.318014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318757+0000","last_change":"2023-08-31T00:28:00.318757+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318757+0000","last_undegraded":"2023-08-31T00:28:00.318757+0000","last_fullsized":"2023-08-31T00:28:00.318757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315539+0000","last_change":"2023-08-31T00:28:00.315539+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315539+0000","last_undegraded":"2023-08-31T00:28:00.315539+0000","last_fullsized":"2023-08-31T00:28:00.315539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318710+0000","last_change":"2023-08-31T00:28:00.318710+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318710+0000","last_undegraded":"2023-08-31T00:28:00.318710+0000","last_fullsized":"2023-08-31T00:28:00.318710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315524+0000","last_change":"2023-08-31T00:28:00.315524+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315524+0000","last_undegraded":"2023-08-31T00:28:00.315524+0000","last_fullsized":"2023-08-31T00:28:00.315524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318659+0000","last_change":"2023-08-31T00:28:00.318659+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318659+0000","last_undegraded":"2023-08-31T00:28:00.318659+0000","last_fullsized":"2023-08-31T00:28:00.318659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319326+0000","last_change":"2023-08-31T00:28:00.319326+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319326+0000","last_undegraded":"2023-08-31T00:28:00.319326+0000","last_fullsized":"2023-08-31T00:28:00.319326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318624+0000","last_change":"2023-08-31T00:28:00.318624+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318624+0000","last_undegraded":"2023-08-31T00:28:00.318624+0000","last_fullsized":"2023-08-31T00:28:00.318624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319027+0000","last_change":"2023-08-31T00:28:00.319027+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319027+0000","last_undegraded":"2023-08-31T00:28:00.319027+0000","last_fullsized":"2023-08-31T00:28:00.319027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T00:27:55.360924+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:27:55.360924+0000","last_peered":"2023-08-31T00:27:55.360924+0000","last_clean":"2023-08-31T00:27:55.360924+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:27:55.360924+0000","last_undegraded":"2023-08-31T00:27:55.360924+0000","last_fullsized":"2023-08-31T00:27:55.360924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.501}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.626}]},{"osd":3,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":712137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.374},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.0579999999999998,"5min":7.0579999999999998,"15min":7.0579999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":7.0229999999999997,"5min":7.0229999999999997,"15min":7.0229999999999997},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":12.702999999999999,"5min":12.702999999999999,"15min":12.702999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":7.2309999999999999,"5min":7.2309999999999999,"15min":7.2309999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.6909999999999998,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.371},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":12.811999999999999,"5min":12.811999999999999,"15min":12.811999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":12.756,"5min":12.756,"15min":12.756},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":12.785,"5min":12.785,"15min":12.785},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.308},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.434}]},{"osd":3,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0540000000000003,"5min":4.0540000000000003,"15min":4.0540000000000003},"last":0.627},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.6180000000000003,"5min":4.6180000000000003,"15min":4.6180000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.375},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":16.422999999999998,"5min":16.422999999999998,"15min":16.422999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:28:06.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:28:06.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b64be7700 1 -- 172.21.15.77:0/1063836476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 msgr2=0x7f8b48004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1063836476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b48004850 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8b50001720 tx=0x7f8b48005880 comp rx=0 tx=0).stop 2023-08-31T00:28:06.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b5ed9d700 1 -- 172.21.15.77:0/1063836476 reap_dead start 2023-08-31T00:28:06.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b64be7700 1 -- 172.21.15.77:0/1063836476 shutdown_connections 2023-08-31T00:28:06.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b64be7700 1 -- 172.21.15.77:0/1063836476 >> 172.21.15.77:0/1063836476 conn(0x7f8b6006cbf0 msgr2=0x7f8b6006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:06.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b64be7700 1 -- 172.21.15.77:0/1063836476 shutdown_connections 2023-08-31T00:28:06.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.982+0000 7f8b64be7700 1 -- 172.21.15.77:0/1063836476 wait complete. 2023-08-31T00:28:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 Processor -- start 2023-08-31T00:28:06.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 -- start start 2023-08-31T00:28:06.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b601e3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b60156ea0 0x7f8b60157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8b6015a9d0 0x7f8b6015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6015b390 con 0x7f8b48004060 2023-08-31T00:28:06.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60154590 con 0x7f8b60156ea0 2023-08-31T00:28:06.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b64be7700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c5eb0 con 0x7f8b6015a9d0 2023-08-31T00:28:06.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b5e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b601e3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b5e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b601e3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40856/0 (socket says 172.21.15.77:40856) 2023-08-31T00:28:06.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.984+0000 7f8b5e59c700 1 -- 172.21.15.77:0/1671849859 learned_addr learned my addr 172.21.15.77:0/1671849859 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5ed9d700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8b6015a9d0 0x7f8b6015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5dd9b700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b60156ea0 0x7f8b60157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5e59c700 1 -- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8b6015a9d0 msgr2=0x7f8b6015ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5e59c700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8b6015a9d0 0x7f8b6015ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5e59c700 1 -- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b60156ea0 msgr2=0x7f8b60157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5e59c700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b60156ea0 0x7f8b60157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5e59c700 1 -- 172.21.15.77:0/1671849859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600c6190 con 0x7f8b48004060 2023-08-31T00:28:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5ed9d700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8b6015a9d0 0x7f8b6015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b5e59c700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b601e3fc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400fa00 tx=0x7f8b5400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400fee0 con 0x7f8b48004060 2023-08-31T00:28:06.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8b54004550 con 0x7f8b48004060 2023-08-31T00:28:06.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600c6470 con 0x7f8b48004060 2023-08-31T00:28:06.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400ba10 con 0x7f8b48004060 2023-08-31T00:28:06.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.985+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600c6a30 con 0x7f8b48004060 2023-08-31T00:28:06.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.986+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60073c30 con 0x7f8b48004060 2023-08-31T00:28:06.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.986+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8b5400bb70 con 0x7f8b48004060 2023-08-31T00:28:06.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.987+0000 7f8b4effd700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:06.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.987+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b54089010 con 0x7f8b48004060 2023-08-31T00:28:06.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.987+0000 7f8b5dd9b700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.987+0000 7f8b5dd9b700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b50001720 tx=0x7f8b50001190 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:06.991+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8b54058310 con 0x7f8b48004060 2023-08-31T00:28:07.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.178+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b600cdbc0 con 0x7f8b4006a0e0 2023-08-31T00:28:07.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.185+0000 7f8b4effd700 1 -- 172.21.15.77:0/1671849859 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276996 (secure 0 0 0) 0x7f8b600cdbc0 con 0x7f8b4006a0e0 2023-08-31T00:28:07.189 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.188+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8b4006a0e0 msgr2=0x7f8b4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.188+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b50001720 tx=0x7f8b50001190 comp rx=0 tx=0).stop 2023-08-31T00:28:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.188+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 msgr2=0x7f8b601e3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.188+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b601e3fc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400fa00 tx=0x7f8b5400fdc0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 shutdown_connections 2023-08-31T00:28:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f8b4006a0e0 0x7f8b4006c5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8b6015a9d0 0x7f8b6015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b48004060 0x7f8b601e3fc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 --2- 172.21.15.77:0/1671849859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b60156ea0 0x7f8b60157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 >> 172.21.15.77:0/1671849859 conn(0x7f8b6006cbf0 msgr2=0x7f8b60152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:07.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 shutdown_connections 2023-08-31T00:28:07.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.189+0000 7f8b64be7700 1 -- 172.21.15.77:0/1671849859 wait complete. 2023-08-31T00:28:07.194 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:28:07.201 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-08-31T00:28:06.129951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3748,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3837952,"data_stored":2183973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.818043"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319730+0000","last_change":"2023-08-31T00:28:00.319730+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319730+0000","last_undegraded":"2023-08-31T00:28:00.319730+0000","last_fullsized":"2023-08-31T00:28:00.319730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316805+0000","last_change":"2023-08-31T00:28:00.316805+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316805+0000","last_undegraded":"2023-08-31T00:28:00.316805+0000","last_fullsized":"2023-08-31T00:28:00.316805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319999+0000","last_change":"2023-08-31T00:28:00.319999+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319999+0000","last_undegraded":"2023-08-31T00:28:00.319999+0000","last_fullsized":"2023-08-31T00:28:00.319999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.322676+0000","last_change":"2023-08-31T00:28:00.322676+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.322676+0000","last_undegraded":"2023-08-31T00:28:00.322676+0000","last_fullsized":"2023-08-31T00:28:00.322676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.321384+0000","last_change":"2023-08-31T00:28:00.321384+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.321384+0000","last_undegraded":"2023-08-31T00:28:00.321384+0000","last_fullsized":"2023-08-31T00:28:00.321384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320547+0000","last_change":"2023-08-31T00:28:00.320547+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320547+0000","last_undegraded":"2023-08-31T00:28:00.320547+0000","last_fullsized":"2023-08-31T00:28:00.320547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319401+0000","last_change":"2023-08-31T00:28:00.319401+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319401+0000","last_undegraded":"2023-08-31T00:28:00.319401+0000","last_fullsized":"2023-08-31T00:28:00.319401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319171+0000","last_change":"2023-08-31T00:28:00.319171+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319171+0000","last_undegraded":"2023-08-31T00:28:00.319171+0000","last_fullsized":"2023-08-31T00:28:00.319171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319120+0000","last_change":"2023-08-31T00:28:00.319120+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319120+0000","last_undegraded":"2023-08-31T00:28:00.319120+0000","last_fullsized":"2023-08-31T00:28:00.319120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316262+0000","last_change":"2023-08-31T00:28:00.316262+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316262+0000","last_undegraded":"2023-08-31T00:28:00.316262+0000","last_fullsized":"2023-08-31T00:28:00.316262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.317969+0000","last_change":"2023-08-31T00:28:00.317969+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.317969+0000","last_undegraded":"2023-08-31T00:28:00.317969+0000","last_fullsized":"2023-08-31T00:28:00.317969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319574+0000","last_change":"2023-08-31T00:28:00.319574+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319574+0000","last_undegraded":"2023-08-31T00:28:00.319574+0000","last_fullsized":"2023-08-31T00:28:00.319574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320876+0000","last_change":"2023-08-31T00:28:00.320876+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320876+0000","last_undegraded":"2023-08-31T00:28:00.320876+0000","last_fullsized":"2023-08-31T00:28:00.320876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319109+0000","last_change":"2023-08-31T00:28:00.319109+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319109+0000","last_undegraded":"2023-08-31T00:28:00.319109+0000","last_fullsized":"2023-08-31T00:28:00.319109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318701+0000","last_change":"2023-08-31T00:28:00.318701+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318701+0000","last_undegraded":"2023-08-31T00:28:00.318701+0000","last_fullsized":"2023-08-31T00:28:00.318701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319126+0000","last_change":"2023-08-31T00:28:00.319126+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319126+0000","last_undegraded":"2023-08-31T00:28:00.319126+0000","last_fullsized":"2023-08-31T00:28:00.319126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319341+0000","last_change":"2023-08-31T00:28:00.319341+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319341+0000","last_undegraded":"2023-08-31T00:28:00.319341+0000","last_fullsized":"2023-08-31T00:28:00.319341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320652+0000","last_change":"2023-08-31T00:28:00.320652+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320652+0000","last_undegraded":"2023-08-31T00:28:00.320652+0000","last_fullsized":"2023-08-31T00:28:00.320652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320523+0000","last_change":"2023-08-31T00:28:00.320523+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320523+0000","last_undegraded":"2023-08-31T00:28:00.320523+0000","last_fullsized":"2023-08-31T00:28:00.320523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319067+0000","last_change":"2023-08-31T00:28:00.319067+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319067+0000","last_undegraded":"2023-08-31T00:28:00.319067+0000","last_fullsized":"2023-08-31T00:28:00.319067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316222+0000","last_change":"2023-08-31T00:28:00.316222+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316222+0000","last_undegraded":"2023-08-31T00:28:00.316222+0000","last_fullsized":"2023-08-31T00:28:00.316222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319045+0000","last_change":"2023-08-31T00:28:00.319045+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319045+0000","last_undegraded":"2023-08-31T00:28:00.319045+0000","last_fullsized":"2023-08-31T00:28:00.319045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320899+0000","last_change":"2023-08-31T00:28:00.320899+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320899+0000","last_undegraded":"2023-08-31T00:28:00.320899+0000","last_fullsized":"2023-08-31T00:28:00.320899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318014+0000","last_change":"2023-08-31T00:28:00.318014+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318014+0000","last_undegraded":"2023-08-31T00:28:00.318014+0000","last_fullsized":"2023-08-31T00:28:00.318014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318757+0000","last_change":"2023-08-31T00:28:00.318757+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318757+0000","last_undegraded":"2023-08-31T00:28:00.318757+0000","last_fullsized":"2023-08-31T00:28:00.318757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315539+0000","last_change":"2023-08-31T00:28:00.315539+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315539+0000","last_undegraded":"2023-08-31T00:28:00.315539+0000","last_fullsized":"2023-08-31T00:28:00.315539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318710+0000","last_change":"2023-08-31T00:28:00.318710+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318710+0000","last_undegraded":"2023-08-31T00:28:00.318710+0000","last_fullsized":"2023-08-31T00:28:00.318710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315524+0000","last_change":"2023-08-31T00:28:00.315524+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315524+0000","last_undegraded":"2023-08-31T00:28:00.315524+0000","last_fullsized":"2023-08-31T00:28:00.315524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318659+0000","last_change":"2023-08-31T00:28:00.318659+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318659+0000","last_undegraded":"2023-08-31T00:28:00.318659+0000","last_fullsized":"2023-08-31T00:28:00.318659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319326+0000","last_change":"2023-08-31T00:28:00.319326+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319326+0000","last_undegraded":"2023-08-31T00:28:00.319326+0000","last_fullsized":"2023-08-31T00:28:00.319326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318624+0000","last_change":"2023-08-31T00:28:00.318624+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318624+0000","last_undegraded":"2023-08-31T00:28:00.318624+0000","last_fullsized":"2023-08-31T00:28:00.318624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319027+0000","last_change":"2023-08-31T00:28:00.319027+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319027+0000","last_undegraded":"2023-08-31T00:28:00.319027+0000","last_fullsized":"2023-08-31T00:28:00.319027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T00:27:55.360924+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:27:55.360924+0000","last_peered":"2023-08-31T00:27:55.360924+0000","last_clean":"2023-08-31T00:27:55.360924+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:27:55.360924+0000","last_undegraded":"2023-08-31T00:27:55.360924+0000","last_fullsized":"2023-08-31T00:27:55.360924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.501}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.626}]},{"osd":3,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":712137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.374},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.0579999999999998,"5min":7.0579999999999998,"15min":7.0579999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":7.0229999999999997,"5min":7.0229999999999997,"15min":7.0229999999999997},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":12.702999999999999,"5min":12.702999999999999,"15min":12.702999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":7.2309999999999999,"5min":7.2309999999999999,"15min":7.2309999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.6909999999999998,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.371},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":12.811999999999999,"5min":12.811999999999999,"15min":12.811999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":12.756,"5min":12.756,"15min":12.756},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":12.785,"5min":12.785,"15min":12.785},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.308},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.434}]},{"osd":3,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0540000000000003,"5min":4.0540000000000003,"15min":4.0540000000000003},"last":0.627},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.6180000000000003,"5min":4.6180000000000003,"15min":4.6180000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.375},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":16.422999999999998,"5min":16.422999999999998,"15min":16.422999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:28:07.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-08-31T00:28:07.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-08-31T00:28:07.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-08-31T00:28:07.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-08-31T00:28:07.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-08-31T00:28:07.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-08-31T00:28:07.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-08-31T00:28:07.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-08-31T00:28:07.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-08-31T00:28:07.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-08-31T00:28:07.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-08-31T00:28:07.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-08-31T00:28:07.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-08-31T00:28:07.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-08-31T00:28:07.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-08-31T00:28:07.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-08-31T00:28:07.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-08-31T00:28:07.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-08-31T00:28:07.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-08-31T00:28:07.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-08-31T00:28:07.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-08-31T00:28:07.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-08-31T00:28:07.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-08-31T00:28:07.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-08-31T00:28:07.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-08-31T00:28:07.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-08-31T00:28:07.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-08-31T00:28:07.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-08-31T00:28:07.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-08-31T00:28:07.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-08-31T00:28:07.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-08-31T00:28:07.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-08-31T00:28:07.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-08-31T00:28:07.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-08-31T00:28:07.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319730+0000', 'last_change': '2023-08-31T00:28:00.319730+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319730+0000', 'last_undegraded': '2023-08-31T00:28:00.319730+0000', 'last_fullsized': '2023-08-31T00:28:00.319730+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-31T00:28:07.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-08-31T00:28:07.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-08-31T00:28:07.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.316805+0000', 'last_change': '2023-08-31T00:28:00.316805+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.316805+0000', 'last_undegraded': '2023-08-31T00:28:00.316805+0000', 'last_fullsized': '2023-08-31T00:28:00.316805+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T00:28:07.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-08-31T00:28:07.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-08-31T00:28:07.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319999+0000', 'last_change': '2023-08-31T00:28:00.319999+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319999+0000', 'last_undegraded': '2023-08-31T00:28:00.319999+0000', 'last_fullsized': '2023-08-31T00:28:00.319999+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-08-31T00:28:07.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-08-31T00:28:07.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.322676+0000', 'last_change': '2023-08-31T00:28:00.322676+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.322676+0000', 'last_undegraded': '2023-08-31T00:28:00.322676+0000', 'last_fullsized': '2023-08-31T00:28:00.322676+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-31T00:28:07.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-08-31T00:28:07.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-08-31T00:28:07.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.321384+0000', 'last_change': '2023-08-31T00:28:00.321384+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.321384+0000', 'last_undegraded': '2023-08-31T00:28:00.321384+0000', 'last_fullsized': '2023-08-31T00:28:00.321384+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-08-31T00:28:07.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-08-31T00:28:07.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.320547+0000', 'last_change': '2023-08-31T00:28:00.320547+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.320547+0000', 'last_undegraded': '2023-08-31T00:28:00.320547+0000', 'last_fullsized': '2023-08-31T00:28:00.320547+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-08-31T00:28:07.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-08-31T00:28:07.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319401+0000', 'last_change': '2023-08-31T00:28:00.319401+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319401+0000', 'last_undegraded': '2023-08-31T00:28:00.319401+0000', 'last_fullsized': '2023-08-31T00:28:00.319401+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-08-31T00:28:07.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-08-31T00:28:07.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319171+0000', 'last_change': '2023-08-31T00:28:00.319171+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319171+0000', 'last_undegraded': '2023-08-31T00:28:00.319171+0000', 'last_fullsized': '2023-08-31T00:28:00.319171+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-08-31T00:28:07.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-08-31T00:28:07.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319120+0000', 'last_change': '2023-08-31T00:28:00.319120+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319120+0000', 'last_undegraded': '2023-08-31T00:28:00.319120+0000', 'last_fullsized': '2023-08-31T00:28:00.319120+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-08-31T00:28:07.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-08-31T00:28:07.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.316262+0000', 'last_change': '2023-08-31T00:28:00.316262+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.316262+0000', 'last_undegraded': '2023-08-31T00:28:00.316262+0000', 'last_fullsized': '2023-08-31T00:28:00.316262+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T00:28:07.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-08-31T00:28:07.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-08-31T00:28:07.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.317969+0000', 'last_change': '2023-08-31T00:28:00.317969+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.317969+0000', 'last_undegraded': '2023-08-31T00:28:00.317969+0000', 'last_fullsized': '2023-08-31T00:28:00.317969+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T00:28:07.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-08-31T00:28:07.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-08-31T00:28:07.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319574+0000', 'last_change': '2023-08-31T00:28:00.319574+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319574+0000', 'last_undegraded': '2023-08-31T00:28:00.319574+0000', 'last_fullsized': '2023-08-31T00:28:00.319574+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-08-31T00:28:07.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-08-31T00:28:07.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.320876+0000', 'last_change': '2023-08-31T00:28:00.320876+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.320876+0000', 'last_undegraded': '2023-08-31T00:28:00.320876+0000', 'last_fullsized': '2023-08-31T00:28:00.320876+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-08-31T00:28:07.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-08-31T00:28:07.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319109+0000', 'last_change': '2023-08-31T00:28:00.319109+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319109+0000', 'last_undegraded': '2023-08-31T00:28:00.319109+0000', 'last_fullsized': '2023-08-31T00:28:00.319109+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T00:28:07.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-08-31T00:28:07.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-08-31T00:28:07.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.318701+0000', 'last_change': '2023-08-31T00:28:00.318701+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.318701+0000', 'last_undegraded': '2023-08-31T00:28:00.318701+0000', 'last_fullsized': '2023-08-31T00:28:00.318701+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-08-31T00:28:07.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-08-31T00:28:07.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319126+0000', 'last_change': '2023-08-31T00:28:00.319126+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319126+0000', 'last_undegraded': '2023-08-31T00:28:00.319126+0000', 'last_fullsized': '2023-08-31T00:28:00.319126+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-08-31T00:28:07.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-08-31T00:28:07.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319341+0000', 'last_change': '2023-08-31T00:28:00.319341+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319341+0000', 'last_undegraded': '2023-08-31T00:28:00.319341+0000', 'last_fullsized': '2023-08-31T00:28:00.319341+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T00:28:07.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-08-31T00:28:07.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-08-31T00:28:07.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.320652+0000', 'last_change': '2023-08-31T00:28:00.320652+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.320652+0000', 'last_undegraded': '2023-08-31T00:28:00.320652+0000', 'last_fullsized': '2023-08-31T00:28:00.320652+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-08-31T00:28:07.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-08-31T00:28:07.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.320523+0000', 'last_change': '2023-08-31T00:28:00.320523+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.320523+0000', 'last_undegraded': '2023-08-31T00:28:00.320523+0000', 'last_fullsized': '2023-08-31T00:28:00.320523+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-08-31T00:28:07.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-08-31T00:28:07.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319067+0000', 'last_change': '2023-08-31T00:28:00.319067+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319067+0000', 'last_undegraded': '2023-08-31T00:28:00.319067+0000', 'last_fullsized': '2023-08-31T00:28:00.319067+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-08-31T00:28:07.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-08-31T00:28:07.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.316222+0000', 'last_change': '2023-08-31T00:28:00.316222+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.316222+0000', 'last_undegraded': '2023-08-31T00:28:00.316222+0000', 'last_fullsized': '2023-08-31T00:28:00.316222+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T00:28:07.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-08-31T00:28:07.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-08-31T00:28:07.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319045+0000', 'last_change': '2023-08-31T00:28:00.319045+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319045+0000', 'last_undegraded': '2023-08-31T00:28:00.319045+0000', 'last_fullsized': '2023-08-31T00:28:00.319045+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-31T00:28:07.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-08-31T00:28:07.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-08-31T00:28:07.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.320899+0000', 'last_change': '2023-08-31T00:28:00.320899+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.320899+0000', 'last_undegraded': '2023-08-31T00:28:00.320899+0000', 'last_fullsized': '2023-08-31T00:28:00.320899+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-08-31T00:28:07.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-08-31T00:28:07.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.318014+0000', 'last_change': '2023-08-31T00:28:00.318014+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.318014+0000', 'last_undegraded': '2023-08-31T00:28:00.318014+0000', 'last_fullsized': '2023-08-31T00:28:00.318014+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T00:28:07.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-08-31T00:28:07.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-08-31T00:28:07.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.318757+0000', 'last_change': '2023-08-31T00:28:00.318757+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.318757+0000', 'last_undegraded': '2023-08-31T00:28:00.318757+0000', 'last_fullsized': '2023-08-31T00:28:00.318757+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T00:28:07.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-08-31T00:28:07.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-08-31T00:28:07.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.315539+0000', 'last_change': '2023-08-31T00:28:00.315539+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.315539+0000', 'last_undegraded': '2023-08-31T00:28:00.315539+0000', 'last_fullsized': '2023-08-31T00:28:00.315539+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T00:28:07.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-08-31T00:28:07.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-08-31T00:28:07.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.318710+0000', 'last_change': '2023-08-31T00:28:00.318710+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.318710+0000', 'last_undegraded': '2023-08-31T00:28:00.318710+0000', 'last_fullsized': '2023-08-31T00:28:00.318710+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T00:28:07.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-08-31T00:28:07.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-08-31T00:28:07.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.315524+0000', 'last_change': '2023-08-31T00:28:00.315524+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.315524+0000', 'last_undegraded': '2023-08-31T00:28:00.315524+0000', 'last_fullsized': '2023-08-31T00:28:00.315524+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T00:28:07.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-08-31T00:28:07.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-08-31T00:28:07.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.318659+0000', 'last_change': '2023-08-31T00:28:00.318659+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.318659+0000', 'last_undegraded': '2023-08-31T00:28:00.318659+0000', 'last_fullsized': '2023-08-31T00:28:00.318659+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-31T00:28:07.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-08-31T00:28:07.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-08-31T00:28:07.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319326+0000', 'last_change': '2023-08-31T00:28:00.319326+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319326+0000', 'last_undegraded': '2023-08-31T00:28:00.319326+0000', 'last_fullsized': '2023-08-31T00:28:00.319326+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T00:28:07.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-08-31T00:28:07.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-08-31T00:28:07.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.318624+0000', 'last_change': '2023-08-31T00:28:00.318624+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.318624+0000', 'last_undegraded': '2023-08-31T00:28:00.318624+0000', 'last_fullsized': '2023-08-31T00:28:00.318624+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T00:28:07.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-08-31T00:28:07.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T00:28:01.311391+0000', 'last_change': '2023-08-31T00:28:01.311391+0000', 'last_active': '2023-08-31T00:28:01.311391+0000', 'last_peered': '2023-08-31T00:28:01.311391+0000', 'last_clean': '2023-08-31T00:28:01.311391+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:01.311391+0000', 'last_undegraded': '2023-08-31T00:28:01.311391+0000', 'last_fullsized': '2023-08-31T00:28:01.311391+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:01.311391+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T00:28:07.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-08-31T00:28:07.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-08-31T00:28:00.319027+0000', 'last_change': '2023-08-31T00:28:00.319027+0000', 'last_active': '2023-08-31T00:28:00.305976+0000', 'last_peered': '2023-08-31T00:28:00.305976+0000', 'last_clean': '2023-08-31T00:28:00.305976+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T00:28:00.319027+0000', 'last_undegraded': '2023-08-31T00:28:00.319027+0000', 'last_fullsized': '2023-08-31T00:28:00.319027+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'last_clean_scrub_stamp': '2023-08-31T00:28:00.305976+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-31T00:28:07.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-31T00:28:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.406+0000 7f122bc71700 1 -- 172.21.15.77:0/2582007681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406f130 msgr2=0x7f1224070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.406+0000 7f122bc71700 1 --2- 172.21.15.77:0/2582007681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406f130 0x7f1224070ac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1224071d50 tx=0x7f1220009c70 comp rx=0 tx=0).stop 2023-08-31T00:28:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 -- 172.21.15.77:0/2582007681 shutdown_connections 2023-08-31T00:28:07.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 --2- 172.21.15.77:0/2582007681 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1224071000 0x7f122415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 --2- 172.21.15.77:0/2582007681 >> v2:172.21.15.139:3300/0 conn(0x7f12241580f0 0x7f12240cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 --2- 172.21.15.77:0/2582007681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f122406f130 0x7f1224070ac0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 -- 172.21.15.77:0/2582007681 >> 172.21.15.77:0/2582007681 conn(0x7f122406cbf0 msgr2=0x7f122406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 -- 172.21.15.77:0/2582007681 shutdown_connections 2023-08-31T00:28:07.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.407+0000 7f122bc71700 1 -- 172.21.15.77:0/2582007681 wait complete. 2023-08-31T00:28:07.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.408+0000 7f122bc71700 1 Processor -- start 2023-08-31T00:28:07.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.408+0000 7f122bc71700 1 -- start start 2023-08-31T00:28:07.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.408+0000 7f122bc71700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f122406f130 0x7f12240ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 0x7f1224158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12241580f0 0x7f12240c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240c2110 con 0x7f1224071000 2023-08-31T00:28:07.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240ca8f0 con 0x7f122406f130 2023-08-31T00:28:07.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12240cabd0 con 0x7f12241580f0 2023-08-31T00:28:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 0x7f1224158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 0x7f1224158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40870/0 (socket says 172.21.15.77:40870) 2023-08-31T00:28:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 -- 172.21.15.77:0/859846077 learned_addr learned my addr 172.21.15.77:0/859846077 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 -- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12241580f0 msgr2=0x7f12240c0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f1229a0d700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f122406f130 0x7f12240ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12241580f0 0x7f12240c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 -- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f122406f130 msgr2=0x7f12240ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f122406f130 0x7f12240ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 -- 172.21.15.77:0/859846077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200095f0 con 0x7f1224071000 2023-08-31T00:28:07.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122920c700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 0x7f1224158fd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f122406c500 tx=0x7f12200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:07.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122001d070 con 0x7f1224071000 2023-08-31T00:28:07.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1220003890 con 0x7f1224071000 2023-08-31T00:28:07.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12240caeb0 con 0x7f1224071000 2023-08-31T00:28:07.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200045f0 con 0x7f1224071000 2023-08-31T00:28:07.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.409+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12240ca600 con 0x7f1224071000 2023-08-31T00:28:07.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.410+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12240cb3d0 con 0x7f1224071000 2023-08-31T00:28:07.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.411+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1220003ca0 con 0x7f1224071000 2023-08-31T00:28:07.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.411+0000 7f121a7fc700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f120806a0e0 0x7f120806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.411+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1220089c80 con 0x7f1224071000 2023-08-31T00:28:07.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.411+0000 7f1229a0d700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f120806a0e0 0x7f120806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.411+0000 7f1229a0d700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f120806a0e0 0x7f120806c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f121400b9c0 tx=0x7f1214005c40 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:07.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.415+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12240cb3d0 con 0x7f1224071000 2023-08-31T00:28:07.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.685+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f12240cb3d0 con 0x7f1224071000 2023-08-31T00:28:07.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.685+0000 7f121a7fc700 1 -- 172.21.15.77:0/859846077 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1268 (secure 0 0 0) 0x7f1220027510 con 0x7f1224071000 2023-08-31T00:28:07.686 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":94,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1693441606,"num_in_osds":8,"osd_in_since":1693441597,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225210368,"bytes_avail":772868902912,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-31T00:27:54.127854+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-31T00:28:07.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f120806a0e0 msgr2=0x7f120806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f120806a0e0 0x7f120806c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f121400b9c0 tx=0x7f1214005c40 comp rx=0 tx=0).stop 2023-08-31T00:28:07.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 msgr2=0x7f1224158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 0x7f1224158fd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f122406c500 tx=0x7f12200042f0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 shutdown_connections 2023-08-31T00:28:07.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f120806a0e0 0x7f120806c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f12241580f0 0x7f12240c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f122406f130 0x7f12240ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 --2- 172.21.15.77:0/859846077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1224071000 0x7f1224158fd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 >> 172.21.15.77:0/859846077 conn(0x7f122406cbf0 msgr2=0x7f122414ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 shutdown_connections 2023-08-31T00:28:07.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.687+0000 7f122bc71700 1 -- 172.21.15.77:0/859846077 wait complete. 2023-08-31T00:28:07.700 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-31T00:28:07.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:28:07.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 -- 172.21.15.77:0/3475968558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2006ff20 msgr2=0x7f1d200cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 --2- 172.21.15.77:0/3475968558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2006ff20 0x7f1d200cc830 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d200ca730 tx=0x7f1d1800b380 comp rx=0 tx=0).stop 2023-08-31T00:28:07.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 -- 172.21.15.77:0/3475968558 shutdown_connections 2023-08-31T00:28:07.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 --2- 172.21.15.77:0/3475968558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2006ff20 0x7f1d200cc830 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 --2- 172.21.15.77:0/3475968558 >> v2:172.21.15.139:3300/0 conn(0x7f1d2006fa90 0x7f1d200cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 -- 172.21.15.77:0/3475968558 >> 172.21.15.77:0/3475968558 conn(0x7f1d20069d50 msgr2=0x7f1d2006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:07.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 -- 172.21.15.77:0/3475968558 shutdown_connections 2023-08-31T00:28:07.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.822+0000 7f1d25441700 1 -- 172.21.15.77:0/3475968558 wait complete. 2023-08-31T00:28:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.823+0000 7f1d25441700 1 Processor -- start 2023-08-31T00:28:07.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.823+0000 7f1d25441700 1 -- start start 2023-08-31T00:28:07.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d25441700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1d2006fa90 0x7f1d2013cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d25441700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2006ff20 0x7f1d201ef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d25441700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 0x7f1d2014be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d25441700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2013c870 con 0x7f1d2014eaf0 2023-08-31T00:28:07.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d25441700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2013bbf0 con 0x7f1d2006ff20 2023-08-31T00:28:07.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d25441700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2013bed0 con 0x7f1d2006fa90 2023-08-31T00:28:07.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 0x7f1d2014be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 0x7f1d2014be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40886/0 (socket says 172.21.15.77:40886) 2023-08-31T00:28:07.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 -- 172.21.15.77:0/4264286061 learned_addr learned my addr 172.21.15.77:0/4264286061 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:07.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1e7fc700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2006ff20 0x7f1d201ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1effd700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1d2006fa90 0x7f1d2013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 -- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1d2006fa90 msgr2=0x7f1d2013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1d2006fa90 0x7f1d2013cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 -- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2006ff20 msgr2=0x7f1d201ef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:07.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2006ff20 0x7f1d201ef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:07.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 -- 172.21.15.77:0/4264286061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d18009d00 con 0x7f1d2014eaf0 2023-08-31T00:28:07.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.824+0000 7f1d1f7fe700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 0x7f1d2014be70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1d200cdb20 tx=0x7f1d180097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:07.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.825+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800e040 con 0x7f1d2014eaf0 2023-08-31T00:28:07.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.825+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d18007a10 con 0x7f1d2014eaf0 2023-08-31T00:28:07.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.825+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2013c1b0 con 0x7f1d2014eaf0 2023-08-31T00:28:07.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.825+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18007e20 con 0x7f1d2014eaf0 2023-08-31T00:28:07.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.825+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2013d1d0 con 0x7f1d2014eaf0 2023-08-31T00:28:07.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.825+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2013c9b0 con 0x7f1d2014eaf0 2023-08-31T00:28:07.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.826+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d18004030 con 0x7f1d2014eaf0 2023-08-31T00:28:07.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.826+0000 7f1d077fe700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1d0c06a0e0 0x7f1d0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:07.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.826+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d18089a20 con 0x7f1d2014eaf0 2023-08-31T00:28:07.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.826+0000 7f1d1effd700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1d0c06a0e0 0x7f1d0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:07.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.827+0000 7f1d1effd700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1d0c06a0e0 0x7f1d0c06c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009960 tx=0x7f1d140090e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:07.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:07.831+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1d2013c9b0 con 0x7f1d2014eaf0 2023-08-31T00:28:08.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.021+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d2013c9b0 con 0x7f1d0c06a0e0 2023-08-31T00:28:08.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.028+0000 7f1d077fe700 1 -- 172.21.15.77:0/4264286061 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276996 (secure 0 0 0) 0x7f1d2013c9b0 con 0x7f1d0c06a0e0 2023-08-31T00:28:08.032 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:08.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1d0c06a0e0 msgr2=0x7f1d0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:08.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1d0c06a0e0 0x7f1d0c06c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009960 tx=0x7f1d140090e0 comp rx=0 tx=0).stop 2023-08-31T00:28:08.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 msgr2=0x7f1d2014be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:08.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 0x7f1d2014be70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1d200cdb20 tx=0x7f1d180097a0 comp rx=0 tx=0).stop 2023-08-31T00:28:08.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 shutdown_connections 2023-08-31T00:28:08.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f1d0c06a0e0 0x7f1d0c06c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:08.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1d2006fa90 0x7f1d2013cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:08.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d2014eaf0 0x7f1d2014be70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:08.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 --2- 172.21.15.77:0/4264286061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d2006ff20 0x7f1d201ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:08.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 >> 172.21.15.77:0/4264286061 conn(0x7f1d20069d50 msgr2=0x7f1d200ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:08.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 shutdown_connections 2023-08-31T00:28:08.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:08.031+0000 7f1d25441700 1 -- 172.21.15.77:0/4264286061 wait complete. 2023-08-31T00:28:08.037 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:28:08.044 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-08-31T00:28:06.129951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3748,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3837952,"data_stored":2183973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.818043"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319730+0000","last_change":"2023-08-31T00:28:00.319730+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319730+0000","last_undegraded":"2023-08-31T00:28:00.319730+0000","last_fullsized":"2023-08-31T00:28:00.319730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316805+0000","last_change":"2023-08-31T00:28:00.316805+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316805+0000","last_undegraded":"2023-08-31T00:28:00.316805+0000","last_fullsized":"2023-08-31T00:28:00.316805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319999+0000","last_change":"2023-08-31T00:28:00.319999+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319999+0000","last_undegraded":"2023-08-31T00:28:00.319999+0000","last_fullsized":"2023-08-31T00:28:00.319999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.322676+0000","last_change":"2023-08-31T00:28:00.322676+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.322676+0000","last_undegraded":"2023-08-31T00:28:00.322676+0000","last_fullsized":"2023-08-31T00:28:00.322676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.321384+0000","last_change":"2023-08-31T00:28:00.321384+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.321384+0000","last_undegraded":"2023-08-31T00:28:00.321384+0000","last_fullsized":"2023-08-31T00:28:00.321384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320547+0000","last_change":"2023-08-31T00:28:00.320547+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320547+0000","last_undegraded":"2023-08-31T00:28:00.320547+0000","last_fullsized":"2023-08-31T00:28:00.320547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319401+0000","last_change":"2023-08-31T00:28:00.319401+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319401+0000","last_undegraded":"2023-08-31T00:28:00.319401+0000","last_fullsized":"2023-08-31T00:28:00.319401+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319171+0000","last_change":"2023-08-31T00:28:00.319171+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319171+0000","last_undegraded":"2023-08-31T00:28:00.319171+0000","last_fullsized":"2023-08-31T00:28:00.319171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319120+0000","last_change":"2023-08-31T00:28:00.319120+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319120+0000","last_undegraded":"2023-08-31T00:28:00.319120+0000","last_fullsized":"2023-08-31T00:28:00.319120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316262+0000","last_change":"2023-08-31T00:28:00.316262+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316262+0000","last_undegraded":"2023-08-31T00:28:00.316262+0000","last_fullsized":"2023-08-31T00:28:00.316262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.317969+0000","last_change":"2023-08-31T00:28:00.317969+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.317969+0000","last_undegraded":"2023-08-31T00:28:00.317969+0000","last_fullsized":"2023-08-31T00:28:00.317969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319574+0000","last_change":"2023-08-31T00:28:00.319574+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319574+0000","last_undegraded":"2023-08-31T00:28:00.319574+0000","last_fullsized":"2023-08-31T00:28:00.319574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320876+0000","last_change":"2023-08-31T00:28:00.320876+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320876+0000","last_undegraded":"2023-08-31T00:28:00.320876+0000","last_fullsized":"2023-08-31T00:28:00.320876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319109+0000","last_change":"2023-08-31T00:28:00.319109+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319109+0000","last_undegraded":"2023-08-31T00:28:00.319109+0000","last_fullsized":"2023-08-31T00:28:00.319109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318701+0000","last_change":"2023-08-31T00:28:00.318701+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318701+0000","last_undegraded":"2023-08-31T00:28:00.318701+0000","last_fullsized":"2023-08-31T00:28:00.318701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319126+0000","last_change":"2023-08-31T00:28:00.319126+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319126+0000","last_undegraded":"2023-08-31T00:28:00.319126+0000","last_fullsized":"2023-08-31T00:28:00.319126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319341+0000","last_change":"2023-08-31T00:28:00.319341+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319341+0000","last_undegraded":"2023-08-31T00:28:00.319341+0000","last_fullsized":"2023-08-31T00:28:00.319341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320652+0000","last_change":"2023-08-31T00:28:00.320652+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320652+0000","last_undegraded":"2023-08-31T00:28:00.320652+0000","last_fullsized":"2023-08-31T00:28:00.320652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320523+0000","last_change":"2023-08-31T00:28:00.320523+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320523+0000","last_undegraded":"2023-08-31T00:28:00.320523+0000","last_fullsized":"2023-08-31T00:28:00.320523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319067+0000","last_change":"2023-08-31T00:28:00.319067+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319067+0000","last_undegraded":"2023-08-31T00:28:00.319067+0000","last_fullsized":"2023-08-31T00:28:00.319067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.316222+0000","last_change":"2023-08-31T00:28:00.316222+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.316222+0000","last_undegraded":"2023-08-31T00:28:00.316222+0000","last_fullsized":"2023-08-31T00:28:00.316222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319045+0000","last_change":"2023-08-31T00:28:00.319045+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319045+0000","last_undegraded":"2023-08-31T00:28:00.319045+0000","last_fullsized":"2023-08-31T00:28:00.319045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.320899+0000","last_change":"2023-08-31T00:28:00.320899+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.320899+0000","last_undegraded":"2023-08-31T00:28:00.320899+0000","last_fullsized":"2023-08-31T00:28:00.320899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318014+0000","last_change":"2023-08-31T00:28:00.318014+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318014+0000","last_undegraded":"2023-08-31T00:28:00.318014+0000","last_fullsized":"2023-08-31T00:28:00.318014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318757+0000","last_change":"2023-08-31T00:28:00.318757+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318757+0000","last_undegraded":"2023-08-31T00:28:00.318757+0000","last_fullsized":"2023-08-31T00:28:00.318757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315539+0000","last_change":"2023-08-31T00:28:00.315539+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315539+0000","last_undegraded":"2023-08-31T00:28:00.315539+0000","last_fullsized":"2023-08-31T00:28:00.315539+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318710+0000","last_change":"2023-08-31T00:28:00.318710+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318710+0000","last_undegraded":"2023-08-31T00:28:00.318710+0000","last_fullsized":"2023-08-31T00:28:00.318710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.315524+0000","last_change":"2023-08-31T00:28:00.315524+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.315524+0000","last_undegraded":"2023-08-31T00:28:00.315524+0000","last_fullsized":"2023-08-31T00:28:00.315524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318659+0000","last_change":"2023-08-31T00:28:00.318659+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318659+0000","last_undegraded":"2023-08-31T00:28:00.318659+0000","last_fullsized":"2023-08-31T00:28:00.318659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319326+0000","last_change":"2023-08-31T00:28:00.319326+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319326+0000","last_undegraded":"2023-08-31T00:28:00.319326+0000","last_fullsized":"2023-08-31T00:28:00.319326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.318624+0000","last_change":"2023-08-31T00:28:00.318624+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.318624+0000","last_undegraded":"2023-08-31T00:28:00.318624+0000","last_fullsized":"2023-08-31T00:28:00.318624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T00:28:01.311391+0000","last_change":"2023-08-31T00:28:01.311391+0000","last_active":"2023-08-31T00:28:01.311391+0000","last_peered":"2023-08-31T00:28:01.311391+0000","last_clean":"2023-08-31T00:28:01.311391+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:01.311391+0000","last_undegraded":"2023-08-31T00:28:01.311391+0000","last_fullsized":"2023-08-31T00:28:01.311391+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-08-31T00:28:00.319027+0000","last_change":"2023-08-31T00:28:00.319027+0000","last_active":"2023-08-31T00:28:00.305976+0000","last_peered":"2023-08-31T00:28:00.305976+0000","last_clean":"2023-08-31T00:28:00.305976+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T00:28:00.319027+0000","last_undegraded":"2023-08-31T00:28:00.319027+0000","last_fullsized":"2023-08-31T00:28:00.319027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T00:27:55.360924+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:27:55.360924+0000","last_peered":"2023-08-31T00:27:55.360924+0000","last_clean":"2023-08-31T00:27:55.360924+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:27:55.360924+0000","last_undegraded":"2023-08-31T00:27:55.360924+0000","last_fullsized":"2023-08-31T00:27:55.360924+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.501}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.441},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.626}]},{"osd":3,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.754},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.433},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":712137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.374},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.0579999999999998,"5min":7.0579999999999998,"15min":7.0579999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":7.0229999999999997,"5min":7.0229999999999997,"15min":7.0229999999999997},"last":0.51100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":12.702999999999999,"5min":12.702999999999999,"15min":12.702999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":7.2309999999999999,"5min":7.2309999999999999,"15min":7.2309999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.6909999999999998,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.371},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":12.811999999999999,"5min":12.811999999999999,"15min":12.811999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":12.756,"5min":12.756,"15min":12.756},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":12.785,"5min":12.785,"15min":12.785},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.308},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.434}]},{"osd":3,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0540000000000003,"5min":4.0540000000000003,"15min":4.0540000000000003},"last":0.627},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.6180000000000003,"5min":4.6180000000000003,"15min":4.6180000000000003},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.375},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":16.422999999999998,"5min":16.422999999999998,"15min":16.422999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:28:11.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T00:28:11.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.188+0000 7f3a95aef700 1 -- 172.21.15.77:0/2173614518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 msgr2=0x7f3a78003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.188+0000 7f3a95aef700 1 --2- 172.21.15.77:0/2173614518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a78003e20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c2e0 tx=0x7f3a78005880 comp rx=0 tx=0).stop 2023-08-31T00:28:11.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.188+0000 7f3a8ffff700 1 -- 172.21.15.77:0/2173614518 reap_dead start 2023-08-31T00:28:11.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.189+0000 7f3a95aef700 1 -- 172.21.15.77:0/2173614518 shutdown_connections 2023-08-31T00:28:11.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.189+0000 7f3a95aef700 1 -- 172.21.15.77:0/2173614518 >> 172.21.15.77:0/2173614518 conn(0x7f3a9006cbf0 msgr2=0x7f3a9006cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:11.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.189+0000 7f3a95aef700 1 -- 172.21.15.77:0/2173614518 shutdown_connections 2023-08-31T00:28:11.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.189+0000 7f3a95aef700 1 -- 172.21.15.77:0/2173614518 wait complete. 2023-08-31T00:28:11.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.190+0000 7f3a95aef700 1 Processor -- start 2023-08-31T00:28:11.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.190+0000 7f3a95aef700 1 -- start start 2023-08-31T00:28:11.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a901533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900c12f0 0x7f3a900c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3a901e32d0 0x7f3a901e3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900c4460 con 0x7f3a78003a00 2023-08-31T00:28:11.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a900c39b0 con 0x7f3a900c12f0 2023-08-31T00:28:11.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901e3c90 con 0x7f3a901e32d0 2023-08-31T00:28:11.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a901533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a901533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40902/0 (socket says 172.21.15.77:40902) 2023-08-31T00:28:11.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 -- 172.21.15.77:0/1910258238 learned_addr learned my addr 172.21.15.77:0/1910258238 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:11.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8effd700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900c12f0 0x7f3a900c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8ffff700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3a901e32d0 0x7f3a901e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 -- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3a901e32d0 msgr2=0x7f3a901e3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3a901e32d0 0x7f3a901e3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 -- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900c12f0 msgr2=0x7f3a900c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900c12f0 0x7f3a900c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 -- 172.21.15.77:0/1910258238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a900c6150 con 0x7f3a78003a00 2023-08-31T00:28:11.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a8f7fe700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a901533c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3a780046a0 tx=0x7f3a80001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:11.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80006650 con 0x7f3a78003a00 2023-08-31T00:28:11.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3a80006b30 con 0x7f3a78003a00 2023-08-31T00:28:11.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a900c1770 con 0x7f3a78003a00 2023-08-31T00:28:11.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.191+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800038c0 con 0x7f3a78003a00 2023-08-31T00:28:11.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.192+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a900c3ea0 con 0x7f3a78003a00 2023-08-31T00:28:11.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.192+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a900c6430 con 0x7f3a78003a00 2023-08-31T00:28:11.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.193+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3a80022070 con 0x7f3a78003a00 2023-08-31T00:28:11.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.193+0000 7f3a77fff700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3a7c06a0e0 0x7f3a7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.193+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a8008a410 con 0x7f3a78003a00 2023-08-31T00:28:11.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.193+0000 7f3a8effd700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3a7c06a0e0 0x7f3a7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.194+0000 7f3a8effd700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3a7c06a0e0 0x7f3a7c06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a900c5a30 tx=0x7f3a84009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:11.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.198+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3a80055be0 con 0x7f3a78003a00 2023-08-31T00:28:11.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.384+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 --> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a901584d0 con 0x7f3a7c06a0e0 2023-08-31T00:28:11.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.391+0000 7f3a77fff700 1 -- 172.21.15.77:0/1910258238 <== mgr.4209 v2:172.21.15.77:6832/3314313596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289034 (secure 0 0 0) 0x7f3a84009db0 con 0x7f3a7c06a0e0 2023-08-31T00:28:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:11.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3a7c06a0e0 msgr2=0x7f3a7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3a7c06a0e0 0x7f3a7c06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3a900c5a30 tx=0x7f3a84009260 comp rx=0 tx=0).stop 2023-08-31T00:28:11.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 msgr2=0x7f3a901533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a901533c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3a780046a0 tx=0x7f3a80001660 comp rx=0 tx=0).stop 2023-08-31T00:28:11.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 shutdown_connections 2023-08-31T00:28:11.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f3a7c06a0e0 0x7f3a7c06c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3a901e32d0 0x7f3a901e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3a78003a00 0x7f3a901533c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 --2- 172.21.15.77:0/1910258238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900c12f0 0x7f3a900c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 >> 172.21.15.77:0/1910258238 conn(0x7f3a9006cbf0 msgr2=0x7f3a90156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:11.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 shutdown_connections 2023-08-31T00:28:11.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.395+0000 7f3a95aef700 1 -- 172.21.15.77:0/1910258238 wait complete. 2023-08-31T00:28:11.400 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-08-31T00:28:11.407 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-08-31T00:28:10.130745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220300,"kb_used_data":4136,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754420,"statfs":{"total":773094113280,"available":772868526080,"internally_reserved":0,"allocated":4235264,"data_stored":2360980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001673"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327019+0000","last_change":"2023-08-31T00:28:02.335200+0000","last_active":"2023-08-31T00:28:03.327019+0000","last_peered":"2023-08-31T00:28:03.327019+0000","last_clean":"2023-08-31T00:28:03.327019+0000","last_became_active":"2023-08-31T00:28:02.334940+0000","last_became_peered":"2023-08-31T00:28:02.334940+0000","last_unstale":"2023-08-31T00:28:03.327019+0000","last_undegraded":"2023-08-31T00:28:03.327019+0000","last_fullsized":"2023-08-31T00:28:03.327019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:49:08.964728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850970+0000","last_change":"2023-08-31T00:28:02.334407+0000","last_active":"2023-08-31T00:28:03.850970+0000","last_peered":"2023-08-31T00:28:03.850970+0000","last_clean":"2023-08-31T00:28:03.850970+0000","last_became_active":"2023-08-31T00:28:02.334136+0000","last_became_peered":"2023-08-31T00:28:02.334136+0000","last_unstale":"2023-08-31T00:28:03.850970+0000","last_undegraded":"2023-08-31T00:28:03.850970+0000","last_fullsized":"2023-08-31T00:28:03.850970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:53:35.759965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851298+0000","last_change":"2023-08-31T00:28:02.342210+0000","last_active":"2023-08-31T00:28:03.851298+0000","last_peered":"2023-08-31T00:28:03.851298+0000","last_clean":"2023-08-31T00:28:03.851298+0000","last_became_active":"2023-08-31T00:28:02.341976+0000","last_became_peered":"2023-08-31T00:28:02.341976+0000","last_unstale":"2023-08-31T00:28:03.851298+0000","last_undegraded":"2023-08-31T00:28:03.851298+0000","last_fullsized":"2023-08-31T00:28:03.851298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:43:25.593056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.774645+0000","last_change":"2023-08-31T00:28:02.343704+0000","last_active":"2023-08-31T00:28:03.774645+0000","last_peered":"2023-08-31T00:28:03.774645+0000","last_clean":"2023-08-31T00:28:03.774645+0000","last_became_active":"2023-08-31T00:28:02.343420+0000","last_became_peered":"2023-08-31T00:28:02.343420+0000","last_unstale":"2023-08-31T00:28:03.774645+0000","last_undegraded":"2023-08-31T00:28:03.774645+0000","last_fullsized":"2023-08-31T00:28:03.774645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:21:37.962374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327357+0000","last_change":"2023-08-31T00:28:02.352881+0000","last_active":"2023-08-31T00:28:03.327357+0000","last_peered":"2023-08-31T00:28:03.327357+0000","last_clean":"2023-08-31T00:28:03.327357+0000","last_became_active":"2023-08-31T00:28:02.352594+0000","last_became_peered":"2023-08-31T00:28:02.352594+0000","last_unstale":"2023-08-31T00:28:03.327357+0000","last_undegraded":"2023-08-31T00:28:03.327357+0000","last_fullsized":"2023-08-31T00:28:03.327357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:04:11.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850733+0000","last_change":"2023-08-31T00:28:02.333031+0000","last_active":"2023-08-31T00:28:03.850733+0000","last_peered":"2023-08-31T00:28:03.850733+0000","last_clean":"2023-08-31T00:28:03.850733+0000","last_became_active":"2023-08-31T00:28:02.332823+0000","last_became_peered":"2023-08-31T00:28:02.332823+0000","last_unstale":"2023-08-31T00:28:03.850733+0000","last_undegraded":"2023-08-31T00:28:03.850733+0000","last_fullsized":"2023-08-31T00:28:03.850733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:43:25.593056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.349908+0000","last_change":"2023-08-31T00:28:02.344645+0000","last_active":"2023-08-31T00:28:03.349908+0000","last_peered":"2023-08-31T00:28:03.349908+0000","last_clean":"2023-08-31T00:28:03.349908+0000","last_became_active":"2023-08-31T00:28:02.344031+0000","last_became_peered":"2023-08-31T00:28:02.344031+0000","last_unstale":"2023-08-31T00:28:03.349908+0000","last_undegraded":"2023-08-31T00:28:03.349908+0000","last_fullsized":"2023-08-31T00:28:03.349908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:17:03.121130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.349763+0000","last_change":"2023-08-31T00:28:02.352957+0000","last_active":"2023-08-31T00:28:03.349763+0000","last_peered":"2023-08-31T00:28:03.349763+0000","last_clean":"2023-08-31T00:28:03.349763+0000","last_became_active":"2023-08-31T00:28:02.352711+0000","last_became_peered":"2023-08-31T00:28:02.352711+0000","last_unstale":"2023-08-31T00:28:03.349763+0000","last_undegraded":"2023-08-31T00:28:03.349763+0000","last_fullsized":"2023-08-31T00:28:03.349763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:21:37.962374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851935+0000","last_change":"2023-08-31T00:28:02.345189+0000","last_active":"2023-08-31T00:28:03.851935+0000","last_peered":"2023-08-31T00:28:03.851935+0000","last_clean":"2023-08-31T00:28:03.851935+0000","last_became_active":"2023-08-31T00:28:02.344850+0000","last_became_peered":"2023-08-31T00:28:02.344850+0000","last_unstale":"2023-08-31T00:28:03.851935+0000","last_undegraded":"2023-08-31T00:28:03.851935+0000","last_fullsized":"2023-08-31T00:28:03.851935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:28:44.181208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.774922+0000","last_change":"2023-08-31T00:28:02.342136+0000","last_active":"2023-08-31T00:28:03.774922+0000","last_peered":"2023-08-31T00:28:03.774922+0000","last_clean":"2023-08-31T00:28:03.774922+0000","last_became_active":"2023-08-31T00:28:02.341862+0000","last_became_peered":"2023-08-31T00:28:02.341862+0000","last_unstale":"2023-08-31T00:28:03.774922+0000","last_undegraded":"2023-08-31T00:28:03.774922+0000","last_fullsized":"2023-08-31T00:28:03.774922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:30:32.135315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350202+0000","last_change":"2023-08-31T00:28:02.345500+0000","last_active":"2023-08-31T00:28:03.350202+0000","last_peered":"2023-08-31T00:28:03.350202+0000","last_clean":"2023-08-31T00:28:03.350202+0000","last_became_active":"2023-08-31T00:28:02.345203+0000","last_became_peered":"2023-08-31T00:28:02.345203+0000","last_unstale":"2023-08-31T00:28:03.350202+0000","last_undegraded":"2023-08-31T00:28:03.350202+0000","last_fullsized":"2023-08-31T00:28:03.350202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:07:15.185720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851067+0000","last_change":"2023-08-31T00:28:02.340867+0000","last_active":"2023-08-31T00:28:03.851067+0000","last_peered":"2023-08-31T00:28:03.851067+0000","last_clean":"2023-08-31T00:28:03.851067+0000","last_became_active":"2023-08-31T00:28:02.340563+0000","last_became_peered":"2023-08-31T00:28:02.340563+0000","last_unstale":"2023-08-31T00:28:03.851067+0000","last_undegraded":"2023-08-31T00:28:03.851067+0000","last_fullsized":"2023-08-31T00:28:03.851067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:01:07.133523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327574+0000","last_change":"2023-08-31T00:28:02.347862+0000","last_active":"2023-08-31T00:28:03.327574+0000","last_peered":"2023-08-31T00:28:03.327574+0000","last_clean":"2023-08-31T00:28:03.327574+0000","last_became_active":"2023-08-31T00:28:02.347524+0000","last_became_peered":"2023-08-31T00:28:02.347524+0000","last_unstale":"2023-08-31T00:28:03.327574+0000","last_undegraded":"2023-08-31T00:28:03.327574+0000","last_fullsized":"2023-08-31T00:28:03.327574+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:42:50.622051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850919+0000","last_change":"2023-08-31T00:28:02.352087+0000","last_active":"2023-08-31T00:28:03.850919+0000","last_peered":"2023-08-31T00:28:03.850919+0000","last_clean":"2023-08-31T00:28:03.850919+0000","last_became_active":"2023-08-31T00:28:02.351811+0000","last_became_peered":"2023-08-31T00:28:02.351811+0000","last_unstale":"2023-08-31T00:28:03.850919+0000","last_undegraded":"2023-08-31T00:28:03.850919+0000","last_fullsized":"2023-08-31T00:28:03.850919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:39:52.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851200+0000","last_change":"2023-08-31T00:28:02.333843+0000","last_active":"2023-08-31T00:28:03.851200+0000","last_peered":"2023-08-31T00:28:03.851200+0000","last_clean":"2023-08-31T00:28:03.851200+0000","last_became_active":"2023-08-31T00:28:02.333556+0000","last_became_peered":"2023-08-31T00:28:02.333556+0000","last_unstale":"2023-08-31T00:28:03.851200+0000","last_undegraded":"2023-08-31T00:28:03.851200+0000","last_fullsized":"2023-08-31T00:28:03.851200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350092+0000","last_change":"2023-08-31T00:28:02.344762+0000","last_active":"2023-08-31T00:28:03.350092+0000","last_peered":"2023-08-31T00:28:03.350092+0000","last_clean":"2023-08-31T00:28:03.350092+0000","last_became_active":"2023-08-31T00:28:02.344400+0000","last_became_peered":"2023-08-31T00:28:02.344400+0000","last_unstale":"2023-08-31T00:28:03.350092+0000","last_undegraded":"2023-08-31T00:28:03.350092+0000","last_fullsized":"2023-08-31T00:28:03.350092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:05:17.323682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350288+0000","last_change":"2023-08-31T00:28:02.343536+0000","last_active":"2023-08-31T00:28:03.350288+0000","last_peered":"2023-08-31T00:28:03.350288+0000","last_clean":"2023-08-31T00:28:03.350288+0000","last_became_active":"2023-08-31T00:28:02.343212+0000","last_became_peered":"2023-08-31T00:28:02.343212+0000","last_unstale":"2023-08-31T00:28:03.350288+0000","last_undegraded":"2023-08-31T00:28:03.350288+0000","last_fullsized":"2023-08-31T00:28:03.350288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:43:25.593056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851072+0000","last_change":"2023-08-31T00:28:02.343338+0000","last_active":"2023-08-31T00:28:03.851072+0000","last_peered":"2023-08-31T00:28:03.851072+0000","last_clean":"2023-08-31T00:28:03.851072+0000","last_became_active":"2023-08-31T00:28:02.342935+0000","last_became_peered":"2023-08-31T00:28:02.342935+0000","last_unstale":"2023-08-31T00:28:03.851072+0000","last_undegraded":"2023-08-31T00:28:03.851072+0000","last_fullsized":"2023-08-31T00:28:03.851072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:09:24.390362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850843+0000","last_change":"2023-08-31T00:28:02.341777+0000","last_active":"2023-08-31T00:28:03.850843+0000","last_peered":"2023-08-31T00:28:03.850843+0000","last_clean":"2023-08-31T00:28:03.850843+0000","last_became_active":"2023-08-31T00:28:02.341511+0000","last_became_peered":"2023-08-31T00:28:02.341511+0000","last_unstale":"2023-08-31T00:28:03.850843+0000","last_undegraded":"2023-08-31T00:28:03.850843+0000","last_fullsized":"2023-08-31T00:28:03.850843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:39.289478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327720+0000","last_change":"2023-08-31T00:28:02.351926+0000","last_active":"2023-08-31T00:28:03.327720+0000","last_peered":"2023-08-31T00:28:03.327720+0000","last_clean":"2023-08-31T00:28:03.327720+0000","last_became_active":"2023-08-31T00:28:02.351413+0000","last_became_peered":"2023-08-31T00:28:02.351413+0000","last_unstale":"2023-08-31T00:28:03.327720+0000","last_undegraded":"2023-08-31T00:28:03.327720+0000","last_fullsized":"2023-08-31T00:28:03.327720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:17:14.509888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850654+0000","last_change":"2023-08-31T00:28:02.343051+0000","last_active":"2023-08-31T00:28:03.850654+0000","last_peered":"2023-08-31T00:28:03.850654+0000","last_clean":"2023-08-31T00:28:03.850654+0000","last_became_active":"2023-08-31T00:28:02.342798+0000","last_became_peered":"2023-08-31T00:28:02.342798+0000","last_unstale":"2023-08-31T00:28:03.850654+0000","last_undegraded":"2023-08-31T00:28:03.850654+0000","last_fullsized":"2023-08-31T00:28:03.850654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:55.208260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851504+0000","last_change":"2023-08-31T00:28:02.345126+0000","last_active":"2023-08-31T00:28:03.851504+0000","last_peered":"2023-08-31T00:28:03.851504+0000","last_clean":"2023-08-31T00:28:03.851504+0000","last_became_active":"2023-08-31T00:28:02.342347+0000","last_became_peered":"2023-08-31T00:28:02.342347+0000","last_unstale":"2023-08-31T00:28:03.851504+0000","last_undegraded":"2023-08-31T00:28:03.851504+0000","last_fullsized":"2023-08-31T00:28:03.851504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:47:57.305330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.326977+0000","last_change":"2023-08-31T00:28:02.339160+0000","last_active":"2023-08-31T00:28:03.326977+0000","last_peered":"2023-08-31T00:28:03.326977+0000","last_clean":"2023-08-31T00:28:03.326977+0000","last_became_active":"2023-08-31T00:28:02.338855+0000","last_became_peered":"2023-08-31T00:28:02.338855+0000","last_unstale":"2023-08-31T00:28:03.326977+0000","last_undegraded":"2023-08-31T00:28:03.326977+0000","last_fullsized":"2023-08-31T00:28:03.326977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:30:32.366920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850571+0000","last_change":"2023-08-31T00:28:02.348389+0000","last_active":"2023-08-31T00:28:03.850571+0000","last_peered":"2023-08-31T00:28:03.850571+0000","last_clean":"2023-08-31T00:28:03.850571+0000","last_became_active":"2023-08-31T00:28:02.348126+0000","last_became_peered":"2023-08-31T00:28:02.348126+0000","last_unstale":"2023-08-31T00:28:03.850571+0000","last_undegraded":"2023-08-31T00:28:03.850571+0000","last_fullsized":"2023-08-31T00:28:03.850571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:05:17.323682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.775048+0000","last_change":"2023-08-31T00:28:02.342194+0000","last_active":"2023-08-31T00:28:03.775048+0000","last_peered":"2023-08-31T00:28:03.775048+0000","last_clean":"2023-08-31T00:28:03.775048+0000","last_became_active":"2023-08-31T00:28:02.341737+0000","last_became_peered":"2023-08-31T00:28:02.341737+0000","last_unstale":"2023-08-31T00:28:03.775048+0000","last_undegraded":"2023-08-31T00:28:03.775048+0000","last_fullsized":"2023-08-31T00:28:03.775048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:05:17.323682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851082+0000","last_change":"2023-08-31T00:28:02.339824+0000","last_active":"2023-08-31T00:28:03.851082+0000","last_peered":"2023-08-31T00:28:03.851082+0000","last_clean":"2023-08-31T00:28:03.851082+0000","last_became_active":"2023-08-31T00:28:02.339165+0000","last_became_peered":"2023-08-31T00:28:02.339165+0000","last_unstale":"2023-08-31T00:28:03.851082+0000","last_undegraded":"2023-08-31T00:28:03.851082+0000","last_fullsized":"2023-08-31T00:28:03.851082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:09.369310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.775035+0000","last_change":"2023-08-31T00:28:02.346608+0000","last_active":"2023-08-31T00:28:03.775035+0000","last_peered":"2023-08-31T00:28:03.775035+0000","last_clean":"2023-08-31T00:28:03.775035+0000","last_became_active":"2023-08-31T00:28:02.346390+0000","last_became_peered":"2023-08-31T00:28:02.346390+0000","last_unstale":"2023-08-31T00:28:03.775035+0000","last_undegraded":"2023-08-31T00:28:03.775035+0000","last_fullsized":"2023-08-31T00:28:03.775035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:38.325741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851198+0000","last_change":"2023-08-31T00:28:02.335408+0000","last_active":"2023-08-31T00:28:03.851198+0000","last_peered":"2023-08-31T00:28:03.851198+0000","last_clean":"2023-08-31T00:28:03.851198+0000","last_became_active":"2023-08-31T00:28:02.335108+0000","last_became_peered":"2023-08-31T00:28:02.335108+0000","last_unstale":"2023-08-31T00:28:03.851198+0000","last_undegraded":"2023-08-31T00:28:03.851198+0000","last_fullsized":"2023-08-31T00:28:03.851198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:07:15.185720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851187+0000","last_change":"2023-08-31T00:28:02.343999+0000","last_active":"2023-08-31T00:28:03.851187+0000","last_peered":"2023-08-31T00:28:03.851187+0000","last_clean":"2023-08-31T00:28:03.851187+0000","last_became_active":"2023-08-31T00:28:02.343710+0000","last_became_peered":"2023-08-31T00:28:02.343710+0000","last_unstale":"2023-08-31T00:28:03.851187+0000","last_undegraded":"2023-08-31T00:28:03.851187+0000","last_fullsized":"2023-08-31T00:28:03.851187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:30:32.366920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350192+0000","last_change":"2023-08-31T00:28:02.344695+0000","last_active":"2023-08-31T00:28:03.350192+0000","last_peered":"2023-08-31T00:28:03.350192+0000","last_clean":"2023-08-31T00:28:03.350192+0000","last_became_active":"2023-08-31T00:28:02.344297+0000","last_became_peered":"2023-08-31T00:28:02.344297+0000","last_unstale":"2023-08-31T00:28:03.350192+0000","last_undegraded":"2023-08-31T00:28:03.350192+0000","last_fullsized":"2023-08-31T00:28:03.350192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:30:32.135315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327010+0000","last_change":"2023-08-31T00:28:02.351706+0000","last_active":"2023-08-31T00:28:03.327010+0000","last_peered":"2023-08-31T00:28:03.327010+0000","last_clean":"2023-08-31T00:28:03.327010+0000","last_became_active":"2023-08-31T00:28:02.351418+0000","last_became_peered":"2023-08-31T00:28:02.351418+0000","last_unstale":"2023-08-31T00:28:03.327010+0000","last_undegraded":"2023-08-31T00:28:03.327010+0000","last_fullsized":"2023-08-31T00:28:03.327010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:03:47.966772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350250+0000","last_change":"2023-08-31T00:28:02.346828+0000","last_active":"2023-08-31T00:28:03.350250+0000","last_peered":"2023-08-31T00:28:03.350250+0000","last_clean":"2023-08-31T00:28:03.350250+0000","last_became_active":"2023-08-31T00:28:02.346567+0000","last_became_peered":"2023-08-31T00:28:02.346567+0000","last_unstale":"2023-08-31T00:28:03.350250+0000","last_undegraded":"2023-08-31T00:28:03.350250+0000","last_fullsized":"2023-08-31T00:28:03.350250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:33:10.620191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327739+0000","last_change":"2023-08-31T00:28:02.339260+0000","last_active":"2023-08-31T00:28:03.327739+0000","last_peered":"2023-08-31T00:28:03.327739+0000","last_clean":"2023-08-31T00:28:03.327739+0000","last_became_active":"2023-08-31T00:28:02.338984+0000","last_became_peered":"2023-08-31T00:28:02.338984+0000","last_unstale":"2023-08-31T00:28:03.327739+0000","last_undegraded":"2023-08-31T00:28:03.327739+0000","last_fullsized":"2023-08-31T00:28:03.327739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:28:44.181208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.359911+0000","last_change":"2023-08-31T00:28:01.341000+0000","last_active":"2023-08-31T00:28:02.359911+0000","last_peered":"2023-08-31T00:28:02.359911+0000","last_clean":"2023-08-31T00:28:02.359911+0000","last_became_active":"2023-08-31T00:28:01.340745+0000","last_became_peered":"2023-08-31T00:28:01.340745+0000","last_unstale":"2023-08-31T00:28:02.359911+0000","last_undegraded":"2023-08-31T00:28:02.359911+0000","last_fullsized":"2023-08-31T00:28:02.359911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:17:13.504473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327127+0000","last_change":"2023-08-31T00:28:02.346996+0000","last_active":"2023-08-31T00:28:03.327127+0000","last_peered":"2023-08-31T00:28:03.327127+0000","last_clean":"2023-08-31T00:28:03.327127+0000","last_became_active":"2023-08-31T00:28:02.346707+0000","last_became_peered":"2023-08-31T00:28:02.346707+0000","last_unstale":"2023-08-31T00:28:03.327127+0000","last_undegraded":"2023-08-31T00:28:03.327127+0000","last_fullsized":"2023-08-31T00:28:03.327127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:30:48.895153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.358684+0000","last_change":"2023-08-31T00:28:01.342968+0000","last_active":"2023-08-31T00:28:02.358684+0000","last_peered":"2023-08-31T00:28:02.358684+0000","last_clean":"2023-08-31T00:28:02.358684+0000","last_became_active":"2023-08-31T00:28:01.342688+0000","last_became_peered":"2023-08-31T00:28:01.342688+0000","last_unstale":"2023-08-31T00:28:02.358684+0000","last_undegraded":"2023-08-31T00:28:02.358684+0000","last_fullsized":"2023-08-31T00:28:02.358684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:03:46.961357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850841+0000","last_change":"2023-08-31T00:28:02.344086+0000","last_active":"2023-08-31T00:28:03.850841+0000","last_peered":"2023-08-31T00:28:03.850841+0000","last_clean":"2023-08-31T00:28:03.850841+0000","last_became_active":"2023-08-31T00:28:02.343763+0000","last_became_peered":"2023-08-31T00:28:02.343763+0000","last_unstale":"2023-08-31T00:28:03.850841+0000","last_undegraded":"2023-08-31T00:28:03.850841+0000","last_fullsized":"2023-08-31T00:28:03.850841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:55:10.953917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.362038+0000","last_change":"2023-08-31T00:28:01.338465+0000","last_active":"2023-08-31T00:28:02.362038+0000","last_peered":"2023-08-31T00:28:02.362038+0000","last_clean":"2023-08-31T00:28:02.362038+0000","last_became_active":"2023-08-31T00:28:01.337085+0000","last_became_peered":"2023-08-31T00:28:01.337085+0000","last_unstale":"2023-08-31T00:28:02.362038+0000","last_undegraded":"2023-08-31T00:28:02.362038+0000","last_fullsized":"2023-08-31T00:28:02.362038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:39:13.947308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.775043+0000","last_change":"2023-08-31T00:28:02.344095+0000","last_active":"2023-08-31T00:28:03.775043+0000","last_peered":"2023-08-31T00:28:03.775043+0000","last_clean":"2023-08-31T00:28:03.775043+0000","last_became_active":"2023-08-31T00:28:02.343813+0000","last_became_peered":"2023-08-31T00:28:02.343813+0000","last_unstale":"2023-08-31T00:28:03.775043+0000","last_undegraded":"2023-08-31T00:28:03.775043+0000","last_fullsized":"2023-08-31T00:28:03.775043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:51:17.816194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.361221+0000","last_change":"2023-08-31T00:28:01.337817+0000","last_active":"2023-08-31T00:28:02.361221+0000","last_peered":"2023-08-31T00:28:02.361221+0000","last_clean":"2023-08-31T00:28:02.361221+0000","last_became_active":"2023-08-31T00:28:01.337566+0000","last_became_peered":"2023-08-31T00:28:01.337566+0000","last_unstale":"2023-08-31T00:28:02.361221+0000","last_undegraded":"2023-08-31T00:28:02.361221+0000","last_fullsized":"2023-08-31T00:28:02.361221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:09:29.113758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.349953+0000","last_change":"2023-08-31T00:28:02.347582+0000","last_active":"2023-08-31T00:28:03.349953+0000","last_peered":"2023-08-31T00:28:03.349953+0000","last_clean":"2023-08-31T00:28:03.349953+0000","last_became_active":"2023-08-31T00:28:02.347268+0000","last_became_peered":"2023-08-31T00:28:02.347268+0000","last_unstale":"2023-08-31T00:28:03.349953+0000","last_undegraded":"2023-08-31T00:28:03.349953+0000","last_fullsized":"2023-08-31T00:28:03.349953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:51:17.816194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.360926+0000","last_change":"2023-08-31T00:28:01.345339+0000","last_active":"2023-08-31T00:28:02.360926+0000","last_peered":"2023-08-31T00:28:02.360926+0000","last_clean":"2023-08-31T00:28:02.360926+0000","last_became_active":"2023-08-31T00:28:01.345009+0000","last_became_peered":"2023-08-31T00:28:01.345009+0000","last_unstale":"2023-08-31T00:28:02.360926+0000","last_undegraded":"2023-08-31T00:28:02.360926+0000","last_fullsized":"2023-08-31T00:28:02.360926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:52:58.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851333+0000","last_change":"2023-08-31T00:28:02.335421+0000","last_active":"2023-08-31T00:28:03.851333+0000","last_peered":"2023-08-31T00:28:03.851333+0000","last_clean":"2023-08-31T00:28:03.851333+0000","last_became_active":"2023-08-31T00:28:02.335138+0000","last_became_peered":"2023-08-31T00:28:02.335138+0000","last_unstale":"2023-08-31T00:28:03.851333+0000","last_undegraded":"2023-08-31T00:28:03.851333+0000","last_fullsized":"2023-08-31T00:28:03.851333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:28:37.420831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.360669+0000","last_change":"2023-08-31T00:28:01.346000+0000","last_active":"2023-08-31T00:28:02.360669+0000","last_peered":"2023-08-31T00:28:02.360669+0000","last_clean":"2023-08-31T00:28:02.360669+0000","last_became_active":"2023-08-31T00:28:01.345710+0000","last_became_peered":"2023-08-31T00:28:01.345710+0000","last_unstale":"2023-08-31T00:28:02.360669+0000","last_undegraded":"2023-08-31T00:28:02.360669+0000","last_fullsized":"2023-08-31T00:28:02.360669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:59:57.677524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850666+0000","last_change":"2023-08-31T00:28:02.343393+0000","last_active":"2023-08-31T00:28:03.850666+0000","last_peered":"2023-08-31T00:28:03.850666+0000","last_clean":"2023-08-31T00:28:03.850666+0000","last_became_active":"2023-08-31T00:28:02.343038+0000","last_became_peered":"2023-08-31T00:28:02.343038+0000","last_unstale":"2023-08-31T00:28:03.850666+0000","last_undegraded":"2023-08-31T00:28:03.850666+0000","last_fullsized":"2023-08-31T00:28:03.850666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:49:08.964728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.327991+0000","last_change":"2023-08-31T00:28:01.338043+0000","last_active":"2023-08-31T00:28:02.327991+0000","last_peered":"2023-08-31T00:28:02.327991+0000","last_clean":"2023-08-31T00:28:02.327991+0000","last_became_active":"2023-08-31T00:28:01.336987+0000","last_became_peered":"2023-08-31T00:28:01.336987+0000","last_unstale":"2023-08-31T00:28:02.327991+0000","last_undegraded":"2023-08-31T00:28:02.327991+0000","last_fullsized":"2023-08-31T00:28:02.327991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:43:11.091752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.774534+0000","last_change":"2023-08-31T00:28:02.338729+0000","last_active":"2023-08-31T00:28:03.774534+0000","last_peered":"2023-08-31T00:28:03.774534+0000","last_clean":"2023-08-31T00:28:03.774534+0000","last_became_active":"2023-08-31T00:28:02.338331+0000","last_became_peered":"2023-08-31T00:28:02.338331+0000","last_unstale":"2023-08-31T00:28:03.774534+0000","last_undegraded":"2023-08-31T00:28:03.774534+0000","last_fullsized":"2023-08-31T00:28:03.774534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:39:14.952723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.337704+0000","last_change":"2023-08-31T00:28:01.345232+0000","last_active":"2023-08-31T00:28:02.337704+0000","last_peered":"2023-08-31T00:28:02.337704+0000","last_clean":"2023-08-31T00:28:02.337704+0000","last_became_active":"2023-08-31T00:28:01.344949+0000","last_became_peered":"2023-08-31T00:28:01.344949+0000","last_unstale":"2023-08-31T00:28:02.337704+0000","last_undegraded":"2023-08-31T00:28:02.337704+0000","last_fullsized":"2023-08-31T00:28:02.337704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:23:33.221756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851314+0000","last_change":"2023-08-31T00:28:02.337449+0000","last_active":"2023-08-31T00:28:03.851314+0000","last_peered":"2023-08-31T00:28:03.851314+0000","last_clean":"2023-08-31T00:28:03.851314+0000","last_became_active":"2023-08-31T00:28:02.337172+0000","last_became_peered":"2023-08-31T00:28:02.337172+0000","last_unstale":"2023-08-31T00:28:03.851314+0000","last_undegraded":"2023-08-31T00:28:03.851314+0000","last_fullsized":"2023-08-31T00:28:03.851314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T02:50:39.289478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.327557+0000","last_change":"2023-08-31T00:28:01.343002+0000","last_active":"2023-08-31T00:28:02.327557+0000","last_peered":"2023-08-31T00:28:02.327557+0000","last_clean":"2023-08-31T00:28:02.327557+0000","last_became_active":"2023-08-31T00:28:01.342750+0000","last_became_peered":"2023-08-31T00:28:01.342750+0000","last_unstale":"2023-08-31T00:28:02.327557+0000","last_undegraded":"2023-08-31T00:28:02.327557+0000","last_fullsized":"2023-08-31T00:28:02.327557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:47:56.299915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851159+0000","last_change":"2023-08-31T00:28:02.343147+0000","last_active":"2023-08-31T00:28:03.851159+0000","last_peered":"2023-08-31T00:28:03.851159+0000","last_clean":"2023-08-31T00:28:03.851159+0000","last_became_active":"2023-08-31T00:28:02.342868+0000","last_became_peered":"2023-08-31T00:28:02.342868+0000","last_unstale":"2023-08-31T00:28:03.851159+0000","last_undegraded":"2023-08-31T00:28:03.851159+0000","last_fullsized":"2023-08-31T00:28:03.851159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:36:28.948750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.332592+0000","last_change":"2023-08-31T00:28:01.340232+0000","last_active":"2023-08-31T00:28:02.332592+0000","last_peered":"2023-08-31T00:28:02.332592+0000","last_clean":"2023-08-31T00:28:02.332592+0000","last_became_active":"2023-08-31T00:28:01.339577+0000","last_became_peered":"2023-08-31T00:28:01.339577+0000","last_unstale":"2023-08-31T00:28:02.332592+0000","last_undegraded":"2023-08-31T00:28:02.332592+0000","last_fullsized":"2023-08-31T00:28:02.332592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:54.202845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850906+0000","last_change":"2023-08-31T00:28:02.339842+0000","last_active":"2023-08-31T00:28:03.850906+0000","last_peered":"2023-08-31T00:28:03.850906+0000","last_clean":"2023-08-31T00:28:03.850906+0000","last_became_active":"2023-08-31T00:28:02.339527+0000","last_became_peered":"2023-08-31T00:28:02.339527+0000","last_unstale":"2023-08-31T00:28:03.850906+0000","last_undegraded":"2023-08-31T00:28:03.850906+0000","last_fullsized":"2023-08-31T00:28:03.850906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:58:14.903695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.360050+0000","last_change":"2023-08-31T00:28:01.343822+0000","last_active":"2023-08-31T00:28:02.360050+0000","last_peered":"2023-08-31T00:28:02.360050+0000","last_clean":"2023-08-31T00:28:02.360050+0000","last_became_active":"2023-08-31T00:28:01.342971+0000","last_became_peered":"2023-08-31T00:28:01.342971+0000","last_unstale":"2023-08-31T00:28:02.360050+0000","last_undegraded":"2023-08-31T00:28:02.360050+0000","last_fullsized":"2023-08-31T00:28:02.360050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:37.242146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851428+0000","last_change":"2023-08-31T00:28:02.342035+0000","last_active":"2023-08-31T00:28:03.851428+0000","last_peered":"2023-08-31T00:28:03.851428+0000","last_clean":"2023-08-31T00:28:03.851428+0000","last_became_active":"2023-08-31T00:28:02.341756+0000","last_became_peered":"2023-08-31T00:28:02.341756+0000","last_unstale":"2023-08-31T00:28:03.851428+0000","last_undegraded":"2023-08-31T00:28:03.851428+0000","last_fullsized":"2023-08-31T00:28:03.851428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:58:14.903695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.364106+0000","last_change":"2023-08-31T00:28:01.338921+0000","last_active":"2023-08-31T00:28:02.364106+0000","last_peered":"2023-08-31T00:28:02.364106+0000","last_clean":"2023-08-31T00:28:02.364106+0000","last_became_active":"2023-08-31T00:28:01.338669+0000","last_became_peered":"2023-08-31T00:28:01.338669+0000","last_unstale":"2023-08-31T00:28:02.364106+0000","last_undegraded":"2023-08-31T00:28:02.364106+0000","last_fullsized":"2023-08-31T00:28:02.364106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:21:36.956958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.774541+0000","last_change":"2023-08-31T00:28:02.342103+0000","last_active":"2023-08-31T00:28:03.774541+0000","last_peered":"2023-08-31T00:28:03.774541+0000","last_clean":"2023-08-31T00:28:03.774541+0000","last_became_active":"2023-08-31T00:28:02.341754+0000","last_became_peered":"2023-08-31T00:28:02.341754+0000","last_unstale":"2023-08-31T00:28:03.774541+0000","last_undegraded":"2023-08-31T00:28:03.774541+0000","last_fullsized":"2023-08-31T00:28:03.774541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T06:43:12.097167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.359749+0000","last_change":"2023-08-31T00:28:01.347389+0000","last_active":"2023-08-31T00:28:02.359749+0000","last_peered":"2023-08-31T00:28:02.359749+0000","last_clean":"2023-08-31T00:28:02.359749+0000","last_became_active":"2023-08-31T00:28:01.347094+0000","last_became_peered":"2023-08-31T00:28:01.347094+0000","last_unstale":"2023-08-31T00:28:02.359749+0000","last_undegraded":"2023-08-31T00:28:02.359749+0000","last_fullsized":"2023-08-31T00:28:02.359749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:39:09.792642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850879+0000","last_change":"2023-08-31T00:28:02.341119+0000","last_active":"2023-08-31T00:28:03.850879+0000","last_peered":"2023-08-31T00:28:03.850879+0000","last_clean":"2023-08-31T00:28:03.850879+0000","last_became_active":"2023-08-31T00:28:02.340854+0000","last_became_peered":"2023-08-31T00:28:02.340854+0000","last_unstale":"2023-08-31T00:28:03.850879+0000","last_undegraded":"2023-08-31T00:28:03.850879+0000","last_fullsized":"2023-08-31T00:28:03.850879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:28:37.420831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.333815+0000","last_change":"2023-08-31T00:28:01.342432+0000","last_active":"2023-08-31T00:28:02.333815+0000","last_peered":"2023-08-31T00:28:02.333815+0000","last_clean":"2023-08-31T00:28:02.333815+0000","last_became_active":"2023-08-31T00:28:01.342150+0000","last_became_peered":"2023-08-31T00:28:01.342150+0000","last_unstale":"2023-08-31T00:28:02.333815+0000","last_undegraded":"2023-08-31T00:28:02.333815+0000","last_fullsized":"2023-08-31T00:28:02.333815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:30:47.889738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350275+0000","last_change":"2023-08-31T00:28:02.347751+0000","last_active":"2023-08-31T00:28:03.350275+0000","last_peered":"2023-08-31T00:28:03.350275+0000","last_clean":"2023-08-31T00:28:03.350275+0000","last_became_active":"2023-08-31T00:28:02.347533+0000","last_became_peered":"2023-08-31T00:28:02.347533+0000","last_unstale":"2023-08-31T00:28:03.350275+0000","last_undegraded":"2023-08-31T00:28:03.350275+0000","last_fullsized":"2023-08-31T00:28:03.350275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:40.049303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.327289+0000","last_change":"2023-08-31T00:28:01.337870+0000","last_active":"2023-08-31T00:28:02.327289+0000","last_peered":"2023-08-31T00:28:02.327289+0000","last_clean":"2023-08-31T00:28:02.327289+0000","last_became_active":"2023-08-31T00:28:01.337601+0000","last_became_peered":"2023-08-31T00:28:01.337601+0000","last_unstale":"2023-08-31T00:28:02.327289+0000","last_undegraded":"2023-08-31T00:28:02.327289+0000","last_fullsized":"2023-08-31T00:28:02.327289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:49:07.959313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.326953+0000","last_change":"2023-08-31T00:28:02.348952+0000","last_active":"2023-08-31T00:28:03.326953+0000","last_peered":"2023-08-31T00:28:03.326953+0000","last_clean":"2023-08-31T00:28:03.326953+0000","last_became_active":"2023-08-31T00:28:02.348666+0000","last_became_peered":"2023-08-31T00:28:02.348666+0000","last_unstale":"2023-08-31T00:28:03.326953+0000","last_undegraded":"2023-08-31T00:28:03.326953+0000","last_fullsized":"2023-08-31T00:28:03.326953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:10:54.500196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.363190+0000","last_change":"2023-08-31T00:28:01.337527+0000","last_active":"2023-08-31T00:28:02.363190+0000","last_peered":"2023-08-31T00:28:02.363190+0000","last_clean":"2023-08-31T00:28:02.363190+0000","last_became_active":"2023-08-31T00:28:01.337058+0000","last_became_peered":"2023-08-31T00:28:01.337058+0000","last_unstale":"2023-08-31T00:28:02.363190+0000","last_undegraded":"2023-08-31T00:28:02.363190+0000","last_fullsized":"2023-08-31T00:28:02.363190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:54.202845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851761+0000","last_change":"2023-08-31T00:28:02.342045+0000","last_active":"2023-08-31T00:28:03.851761+0000","last_peered":"2023-08-31T00:28:03.851761+0000","last_clean":"2023-08-31T00:28:03.851761+0000","last_became_active":"2023-08-31T00:28:02.341753+0000","last_became_peered":"2023-08-31T00:28:02.341753+0000","last_unstale":"2023-08-31T00:28:03.851761+0000","last_undegraded":"2023-08-31T00:28:03.851761+0000","last_fullsized":"2023-08-31T00:28:03.851761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:38.247561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.361112+0000","last_change":"2023-08-31T00:28:01.337905+0000","last_active":"2023-08-31T00:28:02.361112+0000","last_peered":"2023-08-31T00:28:02.361112+0000","last_clean":"2023-08-31T00:28:02.361112+0000","last_became_active":"2023-08-31T00:28:01.337637+0000","last_became_peered":"2023-08-31T00:28:01.337637+0000","last_unstale":"2023-08-31T00:28:02.361112+0000","last_undegraded":"2023-08-31T00:28:02.361112+0000","last_fullsized":"2023-08-31T00:28:02.361112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:47:56.299915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851504+0000","last_change":"2023-08-31T00:28:02.347370+0000","last_active":"2023-08-31T00:28:03.851504+0000","last_peered":"2023-08-31T00:28:03.851504+0000","last_clean":"2023-08-31T00:28:03.851504+0000","last_became_active":"2023-08-31T00:28:02.346858+0000","last_became_peered":"2023-08-31T00:28:02.346858+0000","last_unstale":"2023-08-31T00:28:03.851504+0000","last_undegraded":"2023-08-31T00:28:03.851504+0000","last_fullsized":"2023-08-31T00:28:03.851504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:39:52.487975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.358949+0000","last_change":"2023-08-31T00:28:01.345977+0000","last_active":"2023-08-31T00:28:02.358949+0000","last_peered":"2023-08-31T00:28:02.358949+0000","last_clean":"2023-08-31T00:28:02.358949+0000","last_became_active":"2023-08-31T00:28:01.345680+0000","last_became_peered":"2023-08-31T00:28:01.345680+0000","last_unstale":"2023-08-31T00:28:02.358949+0000","last_undegraded":"2023-08-31T00:28:02.358949+0000","last_fullsized":"2023-08-31T00:28:02.358949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:07:17.187331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.774783+0000","last_change":"2023-08-31T00:28:02.345464+0000","last_active":"2023-08-31T00:28:03.774783+0000","last_peered":"2023-08-31T00:28:03.774783+0000","last_clean":"2023-08-31T00:28:03.774783+0000","last_became_active":"2023-08-31T00:28:02.345201+0000","last_became_peered":"2023-08-31T00:28:02.345201+0000","last_unstale":"2023-08-31T00:28:03.774783+0000","last_undegraded":"2023-08-31T00:28:03.774783+0000","last_fullsized":"2023-08-31T00:28:03.774783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:17:03.121130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.360114+0000","last_change":"2023-08-31T00:28:01.347961+0000","last_active":"2023-08-31T00:28:02.360114+0000","last_peered":"2023-08-31T00:28:02.360114+0000","last_clean":"2023-08-31T00:28:02.360114+0000","last_became_active":"2023-08-31T00:28:01.347661+0000","last_became_peered":"2023-08-31T00:28:01.347661+0000","last_unstale":"2023-08-31T00:28:02.360114+0000","last_undegraded":"2023-08-31T00:28:02.360114+0000","last_fullsized":"2023-08-31T00:28:02.360114+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T07:17:13.504473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327848+0000","last_change":"2023-08-31T00:28:02.347861+0000","last_active":"2023-08-31T00:28:03.327848+0000","last_peered":"2023-08-31T00:28:03.327848+0000","last_clean":"2023-08-31T00:28:03.327848+0000","last_became_active":"2023-08-31T00:28:02.347565+0000","last_became_peered":"2023-08-31T00:28:02.347565+0000","last_unstale":"2023-08-31T00:28:03.327848+0000","last_undegraded":"2023-08-31T00:28:03.327848+0000","last_fullsized":"2023-08-31T00:28:03.327848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:39:10.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.338363+0000","last_change":"2023-08-31T00:28:01.342633+0000","last_active":"2023-08-31T00:28:02.338363+0000","last_peered":"2023-08-31T00:28:02.338363+0000","last_clean":"2023-08-31T00:28:02.338363+0000","last_became_active":"2023-08-31T00:28:01.342316+0000","last_became_peered":"2023-08-31T00:28:01.342316+0000","last_unstale":"2023-08-31T00:28:02.338363+0000","last_undegraded":"2023-08-31T00:28:02.338363+0000","last_fullsized":"2023-08-31T00:28:02.338363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:42:49.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327422+0000","last_change":"2023-08-31T00:28:02.349647+0000","last_active":"2023-08-31T00:28:03.327422+0000","last_peered":"2023-08-31T00:28:03.327422+0000","last_clean":"2023-08-31T00:28:03.327422+0000","last_became_active":"2023-08-31T00:28:02.349370+0000","last_became_peered":"2023-08-31T00:28:02.349370+0000","last_unstale":"2023-08-31T00:28:03.327422+0000","last_undegraded":"2023-08-31T00:28:03.327422+0000","last_fullsized":"2023-08-31T00:28:03.327422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:45:29.980658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.360621+0000","last_change":"2023-08-31T00:28:01.336009+0000","last_active":"2023-08-31T00:28:02.360621+0000","last_peered":"2023-08-31T00:28:02.360621+0000","last_clean":"2023-08-31T00:28:02.360621+0000","last_became_active":"2023-08-31T00:28:01.335563+0000","last_became_peered":"2023-08-31T00:28:01.335563+0000","last_unstale":"2023-08-31T00:28:02.360621+0000","last_undegraded":"2023-08-31T00:28:02.360621+0000","last_fullsized":"2023-08-31T00:28:02.360621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:10:53.494781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327477+0000","last_change":"2023-08-31T00:28:02.348362+0000","last_active":"2023-08-31T00:28:03.327477+0000","last_peered":"2023-08-31T00:28:03.327477+0000","last_clean":"2023-08-31T00:28:03.327477+0000","last_became_active":"2023-08-31T00:28:02.348093+0000","last_became_peered":"2023-08-31T00:28:02.348093+0000","last_unstale":"2023-08-31T00:28:03.327477+0000","last_undegraded":"2023-08-31T00:28:03.327477+0000","last_fullsized":"2023-08-31T00:28:03.327477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:59:58.682939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.330302+0000","last_change":"2023-08-31T00:28:01.340287+0000","last_active":"2023-08-31T00:28:02.330302+0000","last_peered":"2023-08-31T00:28:02.330302+0000","last_clean":"2023-08-31T00:28:02.330302+0000","last_became_active":"2023-08-31T00:28:01.340017+0000","last_became_peered":"2023-08-31T00:28:01.340017+0000","last_unstale":"2023-08-31T00:28:02.330302+0000","last_undegraded":"2023-08-31T00:28:02.330302+0000","last_fullsized":"2023-08-31T00:28:02.330302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:39:09.792642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327273+0000","last_change":"2023-08-31T00:28:02.351934+0000","last_active":"2023-08-31T00:28:03.327273+0000","last_peered":"2023-08-31T00:28:03.327273+0000","last_clean":"2023-08-31T00:28:03.327273+0000","last_became_active":"2023-08-31T00:28:02.351622+0000","last_became_peered":"2023-08-31T00:28:02.351622+0000","last_unstale":"2023-08-31T00:28:03.327273+0000","last_undegraded":"2023-08-31T00:28:03.327273+0000","last_fullsized":"2023-08-31T00:28:03.327273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T01:23:34.227171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.337868+0000","last_change":"2023-08-31T00:28:01.347273+0000","last_active":"2023-08-31T00:28:02.337868+0000","last_peered":"2023-08-31T00:28:02.337868+0000","last_clean":"2023-08-31T00:28:02.337868+0000","last_became_active":"2023-08-31T00:28:01.346998+0000","last_became_peered":"2023-08-31T00:28:01.346998+0000","last_unstale":"2023-08-31T00:28:02.337868+0000","last_undegraded":"2023-08-31T00:28:02.337868+0000","last_fullsized":"2023-08-31T00:28:02.337868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:04:10.713292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.349918+0000","last_change":"2023-08-31T00:28:02.344908+0000","last_active":"2023-08-31T00:28:03.349918+0000","last_peered":"2023-08-31T00:28:03.349918+0000","last_clean":"2023-08-31T00:28:03.349918+0000","last_became_active":"2023-08-31T00:28:02.344367+0000","last_became_peered":"2023-08-31T00:28:02.344367+0000","last_unstale":"2023-08-31T00:28:03.349918+0000","last_undegraded":"2023-08-31T00:28:03.349918+0000","last_fullsized":"2023-08-31T00:28:03.349918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:19:38.325741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.330321+0000","last_change":"2023-08-31T00:28:01.344264+0000","last_active":"2023-08-31T00:28:02.330321+0000","last_peered":"2023-08-31T00:28:02.330321+0000","last_clean":"2023-08-31T00:28:02.330321+0000","last_became_active":"2023-08-31T00:28:01.343992+0000","last_became_peered":"2023-08-31T00:28:01.343992+0000","last_unstale":"2023-08-31T00:28:02.330321+0000","last_undegraded":"2023-08-31T00:28:02.330321+0000","last_fullsized":"2023-08-31T00:28:02.330321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T04:17:02.115715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327795+0000","last_change":"2023-08-31T00:28:02.348114+0000","last_active":"2023-08-31T00:28:03.327795+0000","last_peered":"2023-08-31T00:28:03.327795+0000","last_clean":"2023-08-31T00:28:03.327795+0000","last_became_active":"2023-08-31T00:28:02.347803+0000","last_became_peered":"2023-08-31T00:28:02.347803+0000","last_unstale":"2023-08-31T00:28:03.327795+0000","last_undegraded":"2023-08-31T00:28:03.327795+0000","last_fullsized":"2023-08-31T00:28:03.327795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:52:59.650525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.364337+0000","last_change":"2023-08-31T00:28:01.343667+0000","last_active":"2023-08-31T00:28:02.364337+0000","last_peered":"2023-08-31T00:28:02.364337+0000","last_clean":"2023-08-31T00:28:02.364337+0000","last_became_active":"2023-08-31T00:28:01.343381+0000","last_became_peered":"2023-08-31T00:28:01.343381+0000","last_unstale":"2023-08-31T00:28:02.364337+0000","last_undegraded":"2023-08-31T00:28:02.364337+0000","last_fullsized":"2023-08-31T00:28:02.364337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:37.242146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.851227+0000","last_change":"2023-08-31T00:28:02.343147+0000","last_active":"2023-08-31T00:28:03.851227+0000","last_peered":"2023-08-31T00:28:03.851227+0000","last_clean":"2023-08-31T00:28:03.851227+0000","last_became_active":"2023-08-31T00:28:02.342901+0000","last_became_peered":"2023-08-31T00:28:02.342901+0000","last_unstale":"2023-08-31T00:28:03.851227+0000","last_undegraded":"2023-08-31T00:28:03.851227+0000","last_fullsized":"2023-08-31T00:28:03.851227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:40.049303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327916+0000","last_change":"2023-08-31T00:28:01.340057+0000","last_active":"2023-08-31T00:28:03.327916+0000","last_peered":"2023-08-31T00:28:03.327916+0000","last_clean":"2023-08-31T00:28:03.327916+0000","last_became_active":"2023-08-31T00:28:01.339228+0000","last_became_peered":"2023-08-31T00:28:01.339228+0000","last_unstale":"2023-08-31T00:28:03.327916+0000","last_undegraded":"2023-08-31T00:28:03.327916+0000","last_fullsized":"2023-08-31T00:28:03.327916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:49:07.959313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327123+0000","last_change":"2023-08-31T00:28:02.345402+0000","last_active":"2023-08-31T00:28:03.327123+0000","last_peered":"2023-08-31T00:28:03.327123+0000","last_clean":"2023-08-31T00:28:03.327123+0000","last_became_active":"2023-08-31T00:28:02.345057+0000","last_became_peered":"2023-08-31T00:28:02.345057+0000","last_unstale":"2023-08-31T00:28:03.327123+0000","last_undegraded":"2023-08-31T00:28:03.327123+0000","last_fullsized":"2023-08-31T00:28:03.327123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T10:47:57.305330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.334290+0000","last_change":"2023-08-31T00:28:01.342225+0000","last_active":"2023-08-31T00:28:02.334290+0000","last_peered":"2023-08-31T00:28:02.334290+0000","last_clean":"2023-08-31T00:28:02.334290+0000","last_became_active":"2023-08-31T00:28:01.341366+0000","last_became_peered":"2023-08-31T00:28:01.341366+0000","last_unstale":"2023-08-31T00:28:02.334290+0000","last_undegraded":"2023-08-31T00:28:02.334290+0000","last_fullsized":"2023-08-31T00:28:02.334290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:30:31.361505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327006+0000","last_change":"2023-08-31T00:28:02.340941+0000","last_active":"2023-08-31T00:28:03.327006+0000","last_peered":"2023-08-31T00:28:03.327006+0000","last_clean":"2023-08-31T00:28:03.327006+0000","last_became_active":"2023-08-31T00:28:02.340118+0000","last_became_peered":"2023-08-31T00:28:02.340118+0000","last_unstale":"2023-08-31T00:28:03.327006+0000","last_undegraded":"2023-08-31T00:28:03.327006+0000","last_fullsized":"2023-08-31T00:28:03.327006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T11:49:55.208260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.332197+0000","last_change":"2023-08-31T00:28:01.340010+0000","last_active":"2023-08-31T00:28:02.332197+0000","last_peered":"2023-08-31T00:28:02.332197+0000","last_clean":"2023-08-31T00:28:02.332197+0000","last_became_active":"2023-08-31T00:28:01.339685+0000","last_became_peered":"2023-08-31T00:28:01.339685+0000","last_unstale":"2023-08-31T00:28:02.332197+0000","last_undegraded":"2023-08-31T00:28:02.332197+0000","last_fullsized":"2023-08-31T00:28:02.332197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:07:17.187331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.327491+0000","last_change":"2023-08-31T00:28:02.339795+0000","last_active":"2023-08-31T00:28:03.327491+0000","last_peered":"2023-08-31T00:28:03.327491+0000","last_clean":"2023-08-31T00:28:03.327491+0000","last_became_active":"2023-08-31T00:28:02.339527+0000","last_became_peered":"2023-08-31T00:28:02.339527+0000","last_unstale":"2023-08-31T00:28:03.327491+0000","last_undegraded":"2023-08-31T00:28:03.327491+0000","last_fullsized":"2023-08-31T00:28:03.327491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T03:58:38.247561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.334252+0000","last_change":"2023-08-31T00:28:01.342724+0000","last_active":"2023-08-31T00:28:02.334252+0000","last_peered":"2023-08-31T00:28:02.334252+0000","last_clean":"2023-08-31T00:28:02.334252+0000","last_became_active":"2023-08-31T00:28:01.342383+0000","last_became_peered":"2023-08-31T00:28:01.342383+0000","last_unstale":"2023-08-31T00:28:02.334252+0000","last_undegraded":"2023-08-31T00:28:02.334252+0000","last_fullsized":"2023-08-31T00:28:02.334252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T08:55:09.948502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850542+0000","last_change":"2023-08-31T00:28:02.339223+0000","last_active":"2023-08-31T00:28:03.850542+0000","last_peered":"2023-08-31T00:28:03.850542+0000","last_clean":"2023-08-31T00:28:03.850542+0000","last_became_active":"2023-08-31T00:28:02.338943+0000","last_became_peered":"2023-08-31T00:28:02.338943+0000","last_unstale":"2023-08-31T00:28:03.850542+0000","last_undegraded":"2023-08-31T00:28:03.850542+0000","last_fullsized":"2023-08-31T00:28:03.850542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:56:40.049303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.338646+0000","last_change":"2023-08-31T00:28:01.346597+0000","last_active":"2023-08-31T00:28:02.338646+0000","last_peered":"2023-08-31T00:28:02.338646+0000","last_clean":"2023-08-31T00:28:02.338646+0000","last_became_active":"2023-08-31T00:28:01.346300+0000","last_became_peered":"2023-08-31T00:28:01.346300+0000","last_unstale":"2023-08-31T00:28:02.338646+0000","last_undegraded":"2023-08-31T00:28:02.338646+0000","last_fullsized":"2023-08-31T00:28:02.338646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:45:28.975243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.850773+0000","last_change":"2023-08-31T00:28:02.347365+0000","last_active":"2023-08-31T00:28:03.850773+0000","last_peered":"2023-08-31T00:28:03.850773+0000","last_clean":"2023-08-31T00:28:03.850773+0000","last_became_active":"2023-08-31T00:28:02.346058+0000","last_became_peered":"2023-08-31T00:28:02.346058+0000","last_unstale":"2023-08-31T00:28:03.850773+0000","last_undegraded":"2023-08-31T00:28:03.850773+0000","last_fullsized":"2023-08-31T00:28:03.850773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:30:48.895153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.327525+0000","last_change":"2023-08-31T00:28:01.343664+0000","last_active":"2023-08-31T00:28:02.327525+0000","last_peered":"2023-08-31T00:28:02.327525+0000","last_clean":"2023-08-31T00:28:02.327525+0000","last_became_active":"2023-08-31T00:28:01.343305+0000","last_became_peered":"2023-08-31T00:28:01.343305+0000","last_unstale":"2023-08-31T00:28:02.327525+0000","last_undegraded":"2023-08-31T00:28:02.327525+0000","last_fullsized":"2023-08-31T00:28:02.327525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T05:30:31.361505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T00:28:03.350100+0000","last_change":"2023-08-31T00:28:02.352925+0000","last_active":"2023-08-31T00:28:03.350100+0000","last_peered":"2023-08-31T00:28:03.350100+0000","last_clean":"2023-08-31T00:28:03.350100+0000","last_became_active":"2023-08-31T00:28:02.352641+0000","last_became_peered":"2023-08-31T00:28:02.352641+0000","last_unstale":"2023-08-31T00:28:03.350100+0000","last_undegraded":"2023-08-31T00:28:03.350100+0000","last_fullsized":"2023-08-31T00:28:03.350100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:01.311391+0000","last_clean_scrub_stamp":"2023-08-31T00:28:01.311391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T12:01:07.133523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.329391+0000","last_change":"2023-08-31T00:28:01.345979+0000","last_active":"2023-08-31T00:28:02.329391+0000","last_peered":"2023-08-31T00:28:02.329391+0000","last_clean":"2023-08-31T00:28:02.329391+0000","last_became_active":"2023-08-31T00:28:01.345680+0000","last_became_peered":"2023-08-31T00:28:01.345680+0000","last_unstale":"2023-08-31T00:28:02.329391+0000","last_undegraded":"2023-08-31T00:28:02.329391+0000","last_fullsized":"2023-08-31T00:28:02.329391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:28:00.305976+0000","last_clean_scrub_stamp":"2023-08-31T00:28:00.305976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T00:45:28.975243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-08-31T00:28:02.335228+0000","last_change":"2023-08-31T00:26:48.213052+0000","last_active":"2023-08-31T00:28:02.335228+0000","last_peered":"2023-08-31T00:28:02.335228+0000","last_clean":"2023-08-31T00:28:02.335228+0000","last_became_active":"2023-08-31T00:26:48.212075+0000","last_became_peered":"2023-08-31T00:26:48.212075+0000","last_unstale":"2023-08-31T00:28:02.335228+0000","last_undegraded":"2023-08-31T00:28:02.335228+0000","last_fullsized":"2023-08-31T00:28:02.335228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T00:26:47.135549+0000","last_clean_scrub_stamp":"2023-08-31T00:26:47.135549+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T09:21:44.720708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":737386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4100000000000001,"5min":2.4100000000000001,"15min":2.4100000000000001},"last":0.437},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.62}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.377},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.4399999999999999,"5min":2.4399999999999999,"15min":2.4399999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.44},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.315}]},{"osd":2,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.7069999999999999,"5min":2.7069999999999999,"15min":2.7069999999999999},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Aug 31 00:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.45700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":966656,"data_stored":737296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.28799999999999998}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":0.314},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":6.968,"5min":6.968,"15min":6.968},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.0579999999999998,"5min":7.0579999999999998,"15min":7.0579999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54500000000000004},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":7.0229999999999997,"5min":7.0229999999999997,"15min":7.0229999999999997},"last":0.44700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.308},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.62},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.496},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":148562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":12.702999999999999,"5min":12.702999999999999,"15min":12.702999999999999},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":7.2309999999999999,"5min":7.2309999999999999,"15min":7.2309999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":2.7669999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.6909999999999998,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.505},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":12.811999999999999,"5min":12.811999999999999,"15min":12.811999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":12.756,"5min":12.756,"15min":12.756},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Aug 31 00:27:48 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":12.785,"5min":12.785,"15min":12.785},"last":0.628},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.745}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":2.2189999999999999},"last":0.503}]},{"osd":2,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0540000000000003,"5min":4.0540000000000003,"15min":4.0540000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.6180000000000003,"5min":4.6180000000000003,"15min":4.6180000000000003},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.432}]},{"osd":7,"last update":"Thu Aug 31 00:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":147600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":16.422999999999998,"5min":16.422999999999998,"15min":16.422999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.432}]},{"osd":3,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.497},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.629}]},{"osd":7,"last update":"Thu Aug 31 00:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T00:28:11.413 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T00:28:11.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T00:28:11.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.575+0000 7fe32a078700 1 -- 172.21.15.77:0/4017567513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3240ca990 msgr2=0x7fe3240cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.575+0000 7fe32a078700 1 --2- 172.21.15.77:0/4017567513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3240ca990 0x7fe3240cae40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe3240ce300 tx=0x7fe314009ba0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.576+0000 7fe32a078700 1 -- 172.21.15.77:0/4017567513 shutdown_connections 2023-08-31T00:28:11.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.576+0000 7fe32a078700 1 --2- 172.21.15.77:0/4017567513 >> v2:172.21.15.139:3300/0 conn(0x7fe3240ad840 0x7fe3240afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.576+0000 7fe32a078700 1 --2- 172.21.15.77:0/4017567513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3240ca990 0x7fe3240cae40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.576+0000 7fe32a078700 1 -- 172.21.15.77:0/4017567513 >> 172.21.15.77:0/4017567513 conn(0x7fe3240cde30 msgr2=0x7fe3240ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:11.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.576+0000 7fe32a078700 1 -- 172.21.15.77:0/4017567513 shutdown_connections 2023-08-31T00:28:11.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.576+0000 7fe32a078700 1 -- 172.21.15.77:0/4017567513 wait complete. 2023-08-31T00:28:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.577+0000 7fe32a078700 1 Processor -- start 2023-08-31T00:28:11.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.577+0000 7fe32a078700 1 -- start start 2023-08-31T00:28:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3240ad840 0x7fe32414a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3240ca990 0x7fe3241f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 0x7fe3241526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241e3350 con 0x7fe3241598c0 2023-08-31T00:28:11.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241e2d20 con 0x7fe3240ca990 2023-08-31T00:28:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241510b0 con 0x7fe3240ad840 2023-08-31T00:28:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 0x7fe3241526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 0x7fe3241526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40920/0 (socket says 172.21.15.77:40920) 2023-08-31T00:28:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 -- 172.21.15.77:0/3793709207 learned_addr learned my addr 172.21.15.77:0/3793709207 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe3237fe700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3240ad840 0x7fe32414a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe322ffd700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3240ca990 0x7fe3241f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 -- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3240ad840 msgr2=0x7fe32414a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3240ad840 0x7fe32414a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 -- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3240ca990 msgr2=0x7fe3241f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3240ca990 0x7fe3241f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 -- 172.21.15.77:0/3793709207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009520 con 0x7fe3241598c0 2023-08-31T00:28:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe3237fe700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3240ad840 0x7fe32414a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe322ffd700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3240ca990 0x7fe3241f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe323fff700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 0x7fe3241526b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00cad0 tx=0x7fe31c00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00aac0 con 0x7fe3241598c0 2023-08-31T00:28:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe31c00ad30 con 0x7fe3241598c0 2023-08-31T00:28:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe324151390 con 0x7fe3241598c0 2023-08-31T00:28:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c012680 con 0x7fe3241598c0 2023-08-31T00:28:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.578+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe324152bf0 con 0x7fe3241598c0 2023-08-31T00:28:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.579+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32406a200 con 0x7fe3241598c0 2023-08-31T00:28:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.580+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe31c01b400 con 0x7fe3241598c0 2023-08-31T00:28:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.580+0000 7fe30bfff700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe31006a0b0 0x7fe31006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.580+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe31c088ba0 con 0x7fe3241598c0 2023-08-31T00:28:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.580+0000 7fe3237fe700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe31006a0b0 0x7fe31006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.580+0000 7fe3237fe700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe31006a0b0 0x7fe31006c570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe32406a190 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:11.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.584+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe32406a200 con 0x7fe3241598c0 2023-08-31T00:28:11.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.853+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe3241e3490 con 0x7fe3241598c0 2023-08-31T00:28:11.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.856+0000 7fe30bfff700 1 -- 172.21.15.77:0/3793709207 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe3241e3490 con 0x7fe3241598c0 2023-08-31T00:28:11.858 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-08-31T00:28:11.858 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAY3u9kZfM5BRAA3ct45RKE/VpmqgPOlkxNtQ== 2023-08-31T00:28:11.858 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-08-31T00:28:11.858 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-08-31T00:28:11.858 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-31T00:28:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe31006a0b0 msgr2=0x7fe31006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe31006a0b0 0x7fe31006c570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe32406a190 tx=0x7fe318008040 comp rx=0 tx=0).stop 2023-08-31T00:28:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 msgr2=0x7fe3241526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 0x7fe3241526b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00cad0 tx=0x7fe31c00ce90 comp rx=0 tx=0).stop 2023-08-31T00:28:11.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 shutdown_connections 2023-08-31T00:28:11.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe31006a0b0 0x7fe31006c570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe3240ad840 0x7fe32414a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3241598c0 0x7fe3241526b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 --2- 172.21.15.77:0/3793709207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3240ca990 0x7fe3241f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 >> 172.21.15.77:0/3793709207 conn(0x7fe3240cde30 msgr2=0x7fe3240ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:11.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 shutdown_connections 2023-08-31T00:28:11.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.859+0000 7fe32a078700 1 -- 172.21.15.77:0/3793709207 wait complete. 2023-08-31T00:28:11.865 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-08-31T00:28:11.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T00:28:11.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/862244851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa406f130 msgr2=0x7f5aa4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:11.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/862244851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa406f130 0x7f5aa4070ac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4071d50 tx=0x7f5a94009c70 comp rx=0 tx=0).stop 2023-08-31T00:28:11.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/862244851 shutdown_connections 2023-08-31T00:28:11.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/862244851 >> v2:172.21.15.139:3300/0 conn(0x7f5aa41580f0 0x7f5aa40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/862244851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa406f130 0x7f5aa4070ac0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:11.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/862244851 >> 172.21.15.77:0/862244851 conn(0x7f5aa406cbf0 msgr2=0x7f5aa406cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:11.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/862244851 shutdown_connections 2023-08-31T00:28:11.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.993+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/862244851 wait complete. 2023-08-31T00:28:11.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.994+0000 7f5aa8dc3700 1 Processor -- start 2023-08-31T00:28:11.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.994+0000 7f5aa8dc3700 1 -- start start 2023-08-31T00:28:11.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa8dc3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5aa406f130 0x7f5aa414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa8dc3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 0x7f5aa40c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa8dc3700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5aa41580f0 0x7f5aa40c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:11.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa8dc3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4149c60 con 0x7f5aa4071000 2023-08-31T00:28:11.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa8dc3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4148fe0 con 0x7f5aa406f130 2023-08-31T00:28:11.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa8dc3700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41492c0 con 0x7f5aa41580f0 2023-08-31T00:28:12.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 0x7f5aa40c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 0x7f5aa40c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40932/0 (socket says 172.21.15.77:40932) 2023-08-31T00:28:12.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 -- 172.21.15.77:0/395238901 learned_addr learned my addr 172.21.15.77:0/395238901 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa259c700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5aa406f130 0x7f5aa414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa2d9d700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5aa41580f0 0x7f5aa40c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 -- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5aa41580f0 msgr2=0x7f5aa40c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5aa41580f0 0x7f5aa40c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 -- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5aa406f130 msgr2=0x7f5aa414b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5aa406f130 0x7f5aa414b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 -- 172.21.15.77:0/395238901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a940095f0 con 0x7f5aa4071000 2023-08-31T00:28:12.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa2d9d700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5aa41580f0 0x7f5aa40c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:12.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.995+0000 7f5aa1d9b700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 0x7f5aa40c6140 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5aa406c500 tx=0x7f5a940050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.996+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9401d070 con 0x7f5aa4071000 2023-08-31T00:28:12.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.996+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5a94005e10 con 0x7f5aa4071000 2023-08-31T00:28:12.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.996+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa41495a0 con 0x7f5aa4071000 2023-08-31T00:28:12.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.996+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940044c0 con 0x7f5aa4071000 2023-08-31T00:28:12.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.996+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa40a6620 con 0x7f5aa4071000 2023-08-31T00:28:12.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.997+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa4149da0 con 0x7f5aa4071000 2023-08-31T00:28:12.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.997+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a9400b760 con 0x7f5aa4071000 2023-08-31T00:28:12.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.997+0000 7f5a9affd700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5a8406a0e0 0x7f5a8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.997+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a94089800 con 0x7f5aa4071000 2023-08-31T00:28:12.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.997+0000 7f5aa259c700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5a8406a0e0 0x7f5a8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:11.998+0000 7f5aa259c700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5a8406a0e0 0x7f5a8406c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c005950 tx=0x7f5a8c0058e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.002+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5aa4149da0 con 0x7f5aa4071000 2023-08-31T00:28:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.232+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5aa4071450 con 0x7f5aa4071000 2023-08-31T00:28:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.233+0000 7f5a9affd700 1 -- 172.21.15.77:0/395238901 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f5aa4071450 con 0x7f5aa4071000 2023-08-31T00:28:12.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:12.234 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6834/422218336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":422218336},{"type":"v1","addr":"172.21.15.139:6834","nonce":422218336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/613424595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6833","nonce":613424595},{"type":"v1","addr":"172.21.15.139:6835","nonce":613424595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2380301372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2380301372},{"type":"v1","addr":"172.21.15.77:6836","nonce":2380301372}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T00:28:01.726150+0000","modified":"2023-08-31T00:28:05.343500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/3392518749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":3392518749},{"type":"v1","addr":"172.21.15.77:6837","nonce":3392518749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T00:28:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5a8406a0e0 msgr2=0x7f5a8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5a8406a0e0 0x7f5a8406c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c005950 tx=0x7f5a8c0058e0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 msgr2=0x7f5aa40c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 0x7f5aa40c6140 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5aa406c500 tx=0x7f5a940050d0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 shutdown_connections 2023-08-31T00:28:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f5a8406a0e0 0x7f5a8406c5a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5aa41580f0 0x7f5aa40c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5aa406f130 0x7f5aa414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 --2- 172.21.15.77:0/395238901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5aa4071000 0x7f5aa40c6140 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 >> 172.21.15.77:0/395238901 conn(0x7f5aa406cbf0 msgr2=0x7f5aa40cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 shutdown_connections 2023-08-31T00:28:12.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.235+0000 7f5aa8dc3700 1 -- 172.21.15.77:0/395238901 wait complete. 2023-08-31T00:28:12.238 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2023-08-31T00:28:12.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T00:28:01.726150+0000', 'modified': '2023-08-31T00:28:05.343500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5316}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5316': {'gid': 5316, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/3392518749', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 3392518749}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 3392518749}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-31T00:28:12.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T00:28:12.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T00:28:12.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e71847700 1 -- 172.21.15.77:0/2037434813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 msgr2=0x7f0e54003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e71847700 1 --2- 172.21.15.77:0/2037434813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e54003e50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0e6000c310 tx=0x7f0e54005880 comp rx=0 tx=0).stop 2023-08-31T00:28:12.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/2037434813 reap_dead start 2023-08-31T00:28:12.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e71847700 1 -- 172.21.15.77:0/2037434813 shutdown_connections 2023-08-31T00:28:12.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e71847700 1 -- 172.21.15.77:0/2037434813 >> 172.21.15.77:0/2037434813 conn(0x7f0e6c0af2e0 msgr2=0x7f0e6c0af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e71847700 1 -- 172.21.15.77:0/2037434813 shutdown_connections 2023-08-31T00:28:12.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.776+0000 7f0e71847700 1 -- 172.21.15.77:0/2037434813 wait complete. 2023-08-31T00:28:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.777+0000 7f0e71847700 1 Processor -- start 2023-08-31T00:28:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.777+0000 7f0e71847700 1 -- start start 2023-08-31T00:28:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e71847700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e6c15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e71847700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e6c0a80c0 0x7f0e6c0a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e71847700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c0ae630 0x7f0e6c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e71847700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c15cdd0 con 0x7f0e54003a30 2023-08-31T00:28:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e71847700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0aeff0 con 0x7f0e6c0ae630 2023-08-31T00:28:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e71847700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0a6800 con 0x7f0e6c0a80c0 2023-08-31T00:28:12.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e6affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e6c15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e6affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e6c15b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40950/0 (socket says 172.21.15.77:40950) 2023-08-31T00:28:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e6affd700 1 -- 172.21.15.77:0/4013539551 learned_addr learned my addr 172.21.15.77:0/4013539551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e6c0a80c0 0x7f0e6c0a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.778+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c0ae630 0x7f0e6c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6affd700 1 -- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e6c0a80c0 msgr2=0x7f0e6c0a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6affd700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e6c0a80c0 0x7f0e6c0a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6affd700 1 -- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c0ae630 msgr2=0x7f0e6c0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6affd700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c0ae630 0x7f0e6c0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6affd700 1 -- 172.21.15.77:0/4013539551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0a6ae0 con 0x7f0e54003a30 2023-08-31T00:28:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c0ae630 0x7f0e6c0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:12.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e6affd700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e6c15b060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000c00 tx=0x7f0e60001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e53fff700 1 -- 172.21.15.77:0/4013539551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60003880 con 0x7f0e54003a30 2023-08-31T00:28:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e53fff700 1 -- 172.21.15.77:0/4013539551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e60003ad0 con 0x7f0e54003a30 2023-08-31T00:28:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c0a6dc0 con 0x7f0e54003a30 2023-08-31T00:28:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e53fff700 1 -- 172.21.15.77:0/4013539551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60001640 con 0x7f0e54003a30 2023-08-31T00:28:12.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.779+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c0a7380 con 0x7f0e54003a30 2023-08-31T00:28:12.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.780+0000 7f0e53fff700 1 -- 172.21.15.77:0/4013539551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e60022070 con 0x7f0e54003a30 2023-08-31T00:28:12.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.781+0000 7f0e53fff700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e5806a0e0 0x7f0e5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.781+0000 7f0e53fff700 1 -- 172.21.15.77:0/4013539551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e6008a530 con 0x7f0e54003a30 2023-08-31T00:28:12.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.781+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e5806a0e0 0x7f0e5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.781+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e5806a0e0 0x7f0e5806c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0acb80 tx=0x7f0e5c006bc0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.783+0000 7f0e7d9eab80 1 Processor -- start 2023-08-31T00:28:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.783+0000 7f0e7d9eab80 1 -- start start 2023-08-31T00:28:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775274630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x562775276f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627751d1730 con 0x5627752983e0 2023-08-31T00:28:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627751cf050 con 0x5627752a04a0 2023-08-31T00:28:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627751ca940 con 0x5627752768a0 2023-08-31T00:28:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40958/0 (socket says 172.21.15.77:40958) 2023-08-31T00:28:12.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 -- 172.21.15.77:0/412118084 learned_addr learned my addr 172.21.15.77:0/412118084 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775274630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x562775276f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 -- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 msgr2=0x562775274630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775274630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 -- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 msgr2=0x562775276f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x562775276f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 -- 172.21.15.77:0/412118084 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56277504a5e0 con 0x5627752983e0 2023-08-31T00:28:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x562775276f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e6affd700 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752987c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0e60088b10 tx=0x7f0e600598b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24b65db7eee7e35 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e517fa700 1 -- 172.21.15.77:0/412118084 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6006f030 con 0x5627752983e0 2023-08-31T00:28:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e517fa700 1 -- 172.21.15.77:0/412118084 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e6005a160 con 0x5627752983e0 2023-08-31T00:28:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.784+0000 7f0e517fa700 1 -- 172.21.15.77:0/412118084 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e60059a60 con 0x5627752983e0 2023-08-31T00:28:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/412118084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 msgr2=0x5627752987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752987c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0e60088b10 tx=0x7f0e600598b0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/412118084 shutdown_connections 2023-08-31T00:28:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x562775276f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752987c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/412118084 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775274630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/412118084 >> 172.21.15.77:0/412118084 conn(0x5627751ed090 msgr2=0x5627752be1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/412118084 shutdown_connections 2023-08-31T00:28:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.785+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/412118084 wait complete. 2023-08-31T00:28:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 -- start start 2023-08-31T00:28:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 Processor -- start 2023-08-31T00:28:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x562775296b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x562775168b60 con 0x5627752a04a0 2023-08-31T00:28:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x562775168860 con 0x5627752768a0 2023-08-31T00:28:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.786+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x56277504c8d0 con 0x5627752983e0 2023-08-31T00:28:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e7d9eab80 10 client.0 _ll_register_callbacks cb 0x5627750b2a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T00:28:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40968/0 (socket says 172.21.15.77:40968) 2023-08-31T00:28:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/3957322455 learned_addr learned my addr 172.21.15.77:0/3957322455 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x562775296b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6affd700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 msgr2=0x562775296b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x562775296b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 msgr2=0x5627752a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/3957322455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c0a7380 con 0x5627752a04a0 2023-08-31T00:28:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x562775296b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5240 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0ccc70 tx=0x7f0e64007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13472040f83c41d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-08-31T00:28:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/3957322455 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400e040 con 0x5627752a04a0 2023-08-31T00:28:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/3957322455 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e64003c10 con 0x5627752a04a0 2023-08-31T00:28:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56277526b970 con 0x5627752a04a0 2023-08-31T00:28:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/3957322455 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e64003e10 con 0x5627752a04a0 2023-08-31T00:28:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e7d9eab80 10 client.5517 fetch_fsmap learned FSMap version 16 2023-08-31T00:28:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562774ff6d90 con 0x5627752a04a0 2023-08-31T00:28:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.787+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/3957322455 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x56277526b970 con 0x5627752a04a0 2023-08-31T00:28:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/3957322455 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0e64013630 con 0x5627752a04a0 2023-08-31T00:28:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e7d9eab80 10 client.5517 fetch_fsmap finished waiting for FSMap version 16 2023-08-31T00:28:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e7d9eab80 10 client.5517 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T00:28:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e7d9eab80 20 client.5517 populate_metadata read hostname 'smithi077' 2023-08-31T00:28:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277529ad20 0x5627752a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e7d9eab80 4 client.5517 mds_command: new command op to 5316 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T00:28:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 --> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627751c3920 con 0x56277529ad20 2023-08-31T00:28:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e6affd700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277529ad20 0x5627752a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e4a7fc700 10 client.5517 ms_handle_connect on v2:172.21.15.77:6835/3392518749 2023-08-31T00:28:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e6affd700 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277529ad20 0x5627752a4360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbe86aaadfd821a server_cookie=4210583a75e07920 in_seq=0 out_seq=0 2023-08-31T00:28:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.788+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/3957322455 <== mds.0 v2:172.21.15.77:6835/3392518749 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627751c3920 con 0x56277529ad20 2023-08-31T00:28:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e4a7fc700 10 client.5517 handle_command_reply: tid=0 2023-08-31T00:28:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 client.5517 shutdown 2023-08-31T00:28:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 msgr2=0x5627752b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5240 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0ccc70 tx=0x7f0e64007ce0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 shutdown_connections 2023-08-31T00:28:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277529ad20 0x5627752a4360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5240 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e4a7fc700 0 client.5517 ms_handle_reset on v2:172.21.15.77:6835/3392518749 2023-08-31T00:28:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/3957322455 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x562775296b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 >> 172.21.15.77:0/3957322455 conn(0x5627751ed090 msgr2=0x56277529bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 shutdown_connections 2023-08-31T00:28:12.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/3957322455 wait complete. 2023-08-31T00:28:12.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.789+0000 7f0e7d9eab80 20 client.5517 trim_cache size 0 max 16384 2023-08-31T00:28:12.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.806+0000 7f0e7d9eab80 1 Processor -- start 2023-08-31T00:28:12.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.806+0000 7f0e7d9eab80 1 -- start start 2023-08-31T00:28:12.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x5627752783d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627752b7bc0 con 0x5627752a04a0 2023-08-31T00:28:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277524e8a0 con 0x5627752768a0 2023-08-31T00:28:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x562775295a60 con 0x5627752983e0 2023-08-31T00:28:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40976/0 (socket says 172.21.15.77:40976) 2023-08-31T00:28:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/801223816 learned_addr learned my addr 172.21.15.77:0/801223816 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x5627752783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6affd700 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 msgr2=0x5627752783d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x5627752783d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 msgr2=0x5627752a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6b7fe700 1 -- 172.21.15.77:0/801223816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56277527a250 con 0x5627752a04a0 2023-08-31T00:28:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.807+0000 7f0e6affd700 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5c80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009af0 tx=0x7f0e64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10dc88e7ba29a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e51ffb700 1 -- 172.21.15.77:0/801223816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400e070 con 0x5627752a04a0 2023-08-31T00:28:12.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e51ffb700 1 -- 172.21.15.77:0/801223816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e6400f040 con 0x5627752a04a0 2023-08-31T00:28:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e51ffb700 1 -- 172.21.15.77:0/801223816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004e10 con 0x5627752a04a0 2023-08-31T00:28:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/801223816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 msgr2=0x5627752b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5c80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009af0 tx=0x7f0e64004ad0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/801223816 shutdown_connections 2023-08-31T00:28:12.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752a04a0 0x5627752b5c80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752768a0 0x5627752a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/801223816 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752983e0 0x5627752783d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/801223816 >> 172.21.15.77:0/801223816 conn(0x5627751ed090 msgr2=0x5627752b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/801223816 shutdown_connections 2023-08-31T00:28:12.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.808+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/801223816 wait complete. 2023-08-31T00:28:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.809+0000 7f0e7d9eab80 1 -- start start 2023-08-31T00:28:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.809+0000 7f0e7d9eab80 1 Processor -- start 2023-08-31T00:28:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775293e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x5627752c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627752946a0 con 0x5627752983e0 2023-08-31T00:28:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56277529f000 con 0x5627752a04a0 2023-08-31T00:28:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x56277529ed50 con 0x5627752768a0 2023-08-31T00:28:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 10 client.0 _ll_register_callbacks cb 0x7f0e64009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T00:28:12.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40980/0 (socket says 172.21.15.77:40980) 2023-08-31T00:28:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 -- 172.21.15.77:0/4152421023 learned_addr learned my addr 172.21.15.77:0/4152421023 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6affd700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775293e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6b7fe700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x5627752c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 -- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 msgr2=0x562775293e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775293e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 -- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 msgr2=0x5627752c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T00:28:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x5627752c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 -- 172.21.15.77:0/4152421023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562774ff6d90 con 0x5627752983e0 2023-08-31T00:28:12.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e6a7fc700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752c1d00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c006450 tx=0x7f0e5c014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f81e84115a2c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e4a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-08-31T00:28:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/4152421023 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c023040 con 0x5627752983e0 2023-08-31T00:28:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/4152421023 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e5c01ec80 con 0x5627752983e0 2023-08-31T00:28:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.810+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e6005a160 con 0x5627752983e0 2023-08-31T00:28:12.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/4152421023 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e5c01ee40 con 0x5627752983e0 2023-08-31T00:28:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 10 client.5523 fetch_fsmap learned FSMap version 16 2023-08-31T00:28:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562774fdfc10 con 0x5627752983e0 2023-08-31T00:28:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/4152421023 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e6005a160 con 0x5627752983e0 2023-08-31T00:28:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/4152421023 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0e5c028480 con 0x5627752983e0 2023-08-31T00:28:12.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 10 client.5523 fetch_fsmap finished waiting for FSMap version 16 2023-08-31T00:28:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 10 client.5523 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T00:28:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 20 client.5523 populate_metadata read hostname 'smithi077' 2023-08-31T00:28:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277526cbe0 0x56277526cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 4 client.5523 mds_command: new command op to 5316 tid=0[{"prefix": "status"}] 2023-08-31T00:28:12.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 --> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562775184000 con 0x56277526cbe0 2023-08-31T00:28:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e6affd700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277526cbe0 0x56277526cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e4a7fc700 10 client.5523 ms_handle_connect on v2:172.21.15.77:6835/3392518749 2023-08-31T00:28:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e6affd700 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277526cbe0 0x56277526cfc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca60e54e155c92a0 server_cookie=fff22995e74ba008 in_seq=0 out_seq=0 2023-08-31T00:28:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e4a7fc700 1 -- 172.21.15.77:0/4152421023 <== mds.0 v2:172.21.15.77:6835/3392518749 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562775184000 con 0x56277526cbe0 2023-08-31T00:28:12.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e4a7fc700 10 client.5523 handle_command_reply: tid=0 2023-08-31T00:28:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 1 client.5523 shutdown 2023-08-31T00:28:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 msgr2=0x5627752c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.811+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752c1d00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c006450 tx=0x7f0e5c014070 comp rx=0 tx=0).stop 2023-08-31T00:28:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 shutdown_connections 2023-08-31T00:28:12.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x5627752768a0 0x562775293e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:6835/3392518749,v1:172.21.15.77:6837/3392518749] conn(0x56277526cbe0 0x56277526cfc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627752a04a0 0x5627752c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 --2- 172.21.15.77:0/4152421023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5627752983e0 0x5627752c1d00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e4a7fc700 0 client.5523 ms_handle_reset on v2:172.21.15.77:6835/3392518749 2023-08-31T00:28:12.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 >> 172.21.15.77:0/4152421023 conn(0x5627751ed090 msgr2=0x5627752783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 shutdown_connections 2023-08-31T00:28:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 1 -- 172.21.15.77:0/4152421023 wait complete. 2023-08-31T00:28:12.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e7d9eab80 20 client.5523 trim_cache size 0 max 16384 2023-08-31T00:28:12.833 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-08-31T00:28:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "cd1ac960-5b19-4e71-9e49-9da190b0a8ec", 2023-08-31T00:28:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-08-31T00:28:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5316, 2023-08-31T00:28:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-08-31T00:28:12.834 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-08-31T00:28:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-08-31T00:28:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 10.47643573, 2023-08-31T00:28:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 16, 2023-08-31T00:28:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 33, 2023-08-31T00:28:12.835 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 33, 2023-08-31T00:28:12.836 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 18.360533523000001 2023-08-31T00:28:12.836 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-08-31T00:28:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e5806a0e0 msgr2=0x7f0e5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e5806a0e0 0x7f0e5806c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0acb80 tx=0x7f0e5c006bc0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 msgr2=0x7f0e6c15b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e6c15b060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000c00 tx=0x7f0e60001850 comp rx=0 tx=0).stop 2023-08-31T00:28:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 shutdown_connections 2023-08-31T00:28:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f0e5806a0e0 0x7f0e5806c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c0ae630 0x7f0e6c0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e54003a30 0x7f0e6c15b060 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 --2- 172.21.15.77:0/4013539551 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e6c0a80c0 0x7f0e6c0a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 >> 172.21.15.77:0/4013539551 conn(0x7f0e6c0af2e0 msgr2=0x7f0e6c15b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 shutdown_connections 2023-08-31T00:28:12.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.812+0000 7f0e71847700 1 -- 172.21.15.77:0/4013539551 wait complete. 2023-08-31T00:28:12.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T00:28:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 -- 172.21.15.77:0/3470598896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c1580f0 msgr2=0x7fe43c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 --2- 172.21.15.77:0/3470598896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c1580f0 0x7fe43c0cc250 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0098c0 tx=0x7fe42c009bd0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 -- 172.21.15.77:0/3470598896 shutdown_connections 2023-08-31T00:28:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 --2- 172.21.15.77:0/3470598896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c1580f0 0x7fe43c0cc250 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 -- 172.21.15.77:0/3470598896 >> 172.21.15.77:0/3470598896 conn(0x7fe43c06cbf0 msgr2=0x7fe43c06cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 -- 172.21.15.77:0/3470598896 shutdown_connections 2023-08-31T00:28:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.962+0000 7fe44250c700 1 -- 172.21.15.77:0/3470598896 wait complete. 2023-08-31T00:28:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.963+0000 7fe44250c700 1 Processor -- start 2023-08-31T00:28:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 -- start start 2023-08-31T00:28:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43c06f130 0x7fe43c150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 0x7fe43c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43c1580f0 0x7fe43c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c153690 con 0x7fe43c0711d0 2023-08-31T00:28:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c153970 con 0x7fe43c06f130 2023-08-31T00:28:12.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe44250c700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c153c50 con 0x7fe43c1580f0 2023-08-31T00:28:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe43b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 0x7fe43c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe43b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 0x7fe43c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40994/0 (socket says 172.21.15.77:40994) 2023-08-31T00:28:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.964+0000 7fe43b7fe700 1 -- 172.21.15.77:0/3768813728 learned_addr learned my addr 172.21.15.77:0/3768813728 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe440aa9700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43c1580f0 0x7fe43c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43bfff700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43c06f130 0x7fe43c150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43b7fe700 1 -- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43c1580f0 msgr2=0x7fe43c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43b7fe700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43c1580f0 0x7fe43c0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43b7fe700 1 -- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43c06f130 msgr2=0x7fe43c150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43b7fe700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43c06f130 0x7fe43c150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:12.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43b7fe700 1 -- 172.21.15.77:0/3768813728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c009520 con 0x7fe43c0711d0 2023-08-31T00:28:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe440aa9700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43c1580f0 0x7fe43c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43bfff700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43c06f130 0x7fe43c150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T00:28:12.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe43b7fe700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 0x7fe43c0c5ca0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c4d0 tx=0x7fe43000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430011790 con 0x7fe43c0711d0 2023-08-31T00:28:12.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe4300119e0 con 0x7fe43c0711d0 2023-08-31T00:28:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c153f30 con 0x7fe43c0711d0 2023-08-31T00:28:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430011df0 con 0x7fe43c0711d0 2023-08-31T00:28:12.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.965+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c1532b0 con 0x7fe43c0711d0 2023-08-31T00:28:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.966+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c0c2d90 con 0x7fe43c0711d0 2023-08-31T00:28:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.966+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe43001c460 con 0x7fe43c0711d0 2023-08-31T00:28:12.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.967+0000 7fe438ff9700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42806a0e0 0x7fe42806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:12.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.967+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe430088510 con 0x7fe43c0711d0 2023-08-31T00:28:12.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.967+0000 7fe43bfff700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42806a0e0 0x7fe42806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:12.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.967+0000 7fe43bfff700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42806a0e0 0x7fe42806c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009230 tx=0x7fe42c019040 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:12.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:12.971+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe43c0c2d90 con 0x7fe43c0711d0 2023-08-31T00:28:13.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.203+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe43c0c2d90 con 0x7fe43c0711d0 2023-08-31T00:28:13.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.204+0000 7fe438ff9700 1 -- 172.21.15.77:0/3768813728 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe43c0c2d90 con 0x7fe43c0711d0 2023-08-31T00:28:13.205 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T00:28:13.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42806a0e0 msgr2=0x7fe42806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:13.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42806a0e0 0x7fe42806c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009230 tx=0x7fe42c019040 comp rx=0 tx=0).stop 2023-08-31T00:28:13.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 msgr2=0x7fe43c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:13.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 0x7fe43c0c5ca0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe43000c4d0 tx=0x7fe43000c890 comp rx=0 tx=0).stop 2023-08-31T00:28:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 shutdown_connections 2023-08-31T00:28:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7fe42806a0e0 0x7fe42806c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe43c1580f0 0x7fe43c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe43c06f130 0x7fe43c150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 --2- 172.21.15.77:0/3768813728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe43c0711d0 0x7fe43c0c5ca0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 >> 172.21.15.77:0/3768813728 conn(0x7fe43c06cbf0 msgr2=0x7fe43c0c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 shutdown_connections 2023-08-31T00:28:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:13.206+0000 7fe44250c700 1 -- 172.21.15.77:0/3768813728 wait complete. 2023-08-31T00:28:13.218 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T00:28:13.219 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T00:28:13.219 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-08-31T00:28:13.220 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T00:28:13.220 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T00:28:13.221 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T00:28:13.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T00:28:13.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T00:28:13.222 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T00:28:13.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.223 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-08-31T00:28:13.240 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T00:28:13.240 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T00:28:13.240 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T00:28:13.240 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.241 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-08-31T00:28:13.241 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.241 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:28:13.241 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:28:13.241 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:28:13.242 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:28:13.242 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T00:28:13.242 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:28:13.242 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T00:28:13.242 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-08-31T00:28:13.243 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T00:28:13.243 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42257sec preferred_lft 42257sec 2023-08-31T00:28:13.243 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::4efd:2ec9:41be:dee6/64 scope link noprefixroute 2023-08-31T00:28:13.243 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.243 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T00:28:13.244 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0a:55:97:80:44:3f brd ff:ff:ff:ff:ff:ff 2023-08-31T00:28:13.244 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T00:28:13.244 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.244 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c83c:e4ff:fea6:d38a/64 scope link 2023-08-31T00:28:13.244 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.244 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T00:28:13.245 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0a:55:97:80:44:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T00:28:13.245 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::855:97ff:fe80:443f/64 scope link 2023-08-31T00:28:13.245 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.246 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T00:28:13.246 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether c6:60:fd:2c:6b:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T00:28:13.246 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::c460:fdff:fe2c:6b29/64 scope link 2023-08-31T00:28:13.247 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-08-31T00:28:13.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.248 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T00:28:13.305 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-08-31T00:28:13.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.307 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-08-31T00:28:13.367 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-08-31T00:28:13.367 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T00:28:13.367 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T00:28:13.367 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T00:28:13.368 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T00:28:13.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.368 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-08-31T00:28:13.369 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-08-31T00:28:13.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T00:28:13.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T00:28:13.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T00:28:13.370 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-08-31T00:28:13.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.476 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-08-31T00:28:13.493 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T00:28:13.494 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T00:28:13.494 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T00:28:13.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-08-31T00:28:13.560 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-31T00:28:13.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:28:13.561 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-31T00:28:13.616 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-31T00:28:13.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T00:28:13.617 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-31T00:28:13.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-08-31T00:28:13.740 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:28:13.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:28:13.806 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:28:13.807 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:28:13.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:13.808 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-08-31T00:28:13.865 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T00:28:13.866 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-31T00:28:13.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-08-31T00:28:13.934 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T00:28:13.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T00:28:13.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-08-31T00:28:13.994+0000 7f8d3ead15c0 -1 init, newargv = 0x55c14ccfdd80 newargc=15 2023-08-31T00:28:13.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[120416]: starting ceph client 2023-08-31T00:28:13.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[120416]: starting fuse 2023-08-31T00:28:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T00:28:14.003 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T00:28:14.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:14.004 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-08-31T00:28:14.061 INFO:teuthology.orchestra.run.smithi077.stdout:47 2023-08-31T00:28:14.062 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-08-31T00:28:14.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2023-08-31T00:28:14.063 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-08-31T00:28:14.063 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-08-31T00:28:14.063 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-08-31T00:28:14.064 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-08-31T00:28:14.064 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:28:14.065 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-08-31T00:28:14.065 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-31T00:28:14.065 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-08-31T00:28:14.066 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-31T00:28:14.066 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:28:14.067 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-08-31T00:28:14.067 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-08-31T00:28:14.067 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-08-31T00:28:14.068 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-08-31T00:28:14.068 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:28:14.068 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-08-31T00:28:14.069 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T00:28:14.069 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T00:28:14.070 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T00:28:14.070 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-08-31T00:28:14.070 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-08-31T00:28:14.071 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-08-31T00:28:14.071 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T00:28:14.071 DEBUG:teuthology.orchestra.run.smithi077:> 2023-08-31T00:28:14.072 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-08-31T00:28:14.072 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-08-31T00:28:14.184 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.120416.asok 2023-08-31T00:28:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T00:28:14.193 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.120416.asok 2023-08-31T00:28:14.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:14.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.120416.asok status 2023-08-31T00:28:14.349 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-08-31T00:28:14.349 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-08-31T00:28:14.349 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T00:28:14.350 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T00:28:14.350 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-08-31T00:28:14.350 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-08-31T00:28:14.350 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-31T00:28:14.350 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "120416", 2023-08-31T00:28:14.351 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-08-31T00:28:14.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:28:14.351 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-08-31T00:28:14.351 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-08-31T00:28:14.351 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5538, 2023-08-31T00:28:14.352 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-08-31T00:28:14.352 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-08-31T00:28:14.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-08-31T00:28:14.352 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 5538 2023-08-31T00:28:14.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:28:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-08-31T00:28:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-08-31T00:28:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-08-31T00:28:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1138440929 2023-08-31T00:28:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-08-31T00:28:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:28:14.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-08-31T00:28:14.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-08-31T00:28:14.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-08-31T00:28:14.354 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1138440929 2023-08-31T00:28:14.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-08-31T00:28:14.355 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.5538 192.168.0.1:0/1138440929", 2023-08-31T00:28:14.355 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1138440929", 2023-08-31T00:28:14.355 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-08-31T00:28:14.356 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 16, 2023-08-31T00:28:14.356 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 33, 2023-08-31T00:28:14.356 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-08-31T00:28:14.357 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-08-31T00:28:14.357 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-08-31T00:28:14.357 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-08-31T00:28:14.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:14.360 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-08-31T00:28:14.360 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-31T00:28:14.377 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-08-31T00:28:14.377 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-31T00:28:14.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:14.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T00:28:14.444 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=xfstests-dev 2023-08-31T00:28:14.501 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.iDdVgFzsFDxfstests-dev 2023-08-31T00:28:14.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:14.502 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.iDdVgFzsFDxfstests-dev) 2023-08-31T00:28:14.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:14.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.iDdVgFzsFDxfstests-dev) 2023-08-31T00:28:14.626 INFO:teuthology.orchestra.run.smithi077.stderr:Cloning into '/tmp/tmp.iDdVgFzsFDxfstests-dev'... 2023-08-31T00:28:15.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:15.326 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-08-31T00:28:15.387 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=test 2023-08-31T00:28:15.443 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.8SsQQTYHahtest 2023-08-31T00:28:15.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:28:15.444 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-08-31T00:28:15.502 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=scratch 2023-08-31T00:28:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.FA4yhEzqpDscratch 2023-08-31T00:28:15.561 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-08-31T00:28:15.562 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-08-31T00:28:15.959 INFO:teuthology.orchestra.run.smithi077.stdout:Updating Subscription Management repositories. 2023-08-31T00:28:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:04:31 ago on Thu 31 Aug 2023 12:23:46 AM UTC. 2023-08-31T00:28:18.930 INFO:teuthology.orchestra.run.smithi077.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T00:28:18.931 INFO:teuthology.orchestra.run.smithi077.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T00:28:18.933 INFO:teuthology.orchestra.run.smithi077.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-08-31T00:28:18.934 INFO:teuthology.orchestra.run.smithi077.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-08-31T00:28:18.935 INFO:teuthology.orchestra.run.smithi077.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-08-31T00:28:18.937 INFO:teuthology.orchestra.run.smithi077.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-08-31T00:28:18.940 INFO:teuthology.orchestra.run.smithi077.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-08-31T00:28:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-08-31T00:28:18.943 INFO:teuthology.orchestra.run.smithi077.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-08-31T00:28:18.944 INFO:teuthology.orchestra.run.smithi077.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-08-31T00:28:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-08-31T00:28:18.947 INFO:teuthology.orchestra.run.smithi077.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-08-31T00:28:18.948 INFO:teuthology.orchestra.run.smithi077.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-08-31T00:28:18.949 INFO:teuthology.orchestra.run.smithi077.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-08-31T00:28:18.950 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T00:28:18.952 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T00:28:18.953 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T00:28:18.954 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T00:28:18.956 INFO:teuthology.orchestra.run.smithi077.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-08-31T00:28:18.957 INFO:teuthology.orchestra.run.smithi077.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T00:28:18.958 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T00:28:18.962 INFO:teuthology.orchestra.run.smithi077.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-08-31T00:28:18.963 INFO:teuthology.orchestra.run.smithi077.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-08-31T00:28:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T00:28:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2023-08-31T00:28:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-08-31T00:28:19.081 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2023-08-31T00:28:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-08-31T00:28:19.081 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2023-08-31T00:28:19.081 INFO:teuthology.orchestra.run.smithi077.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-08-31T00:28:19.082 INFO:teuthology.orchestra.run.smithi077.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T00:28:19.082 INFO:teuthology.orchestra.run.smithi077.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-08-31T00:28:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2023-08-31T00:28:19.082 INFO:teuthology.orchestra.run.smithi077.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-08-31T00:28:19.082 INFO:teuthology.orchestra.run.smithi077.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-08-31T00:28:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2023-08-31T00:28:19.083 INFO:teuthology.orchestra.run.smithi077.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-08-31T00:28:19.083 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-08-31T00:28:19.083 INFO:teuthology.orchestra.run.smithi077.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-08-31T00:28:19.083 INFO:teuthology.orchestra.run.smithi077.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-08-31T00:28:19.084 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2023-08-31T00:28:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2023-08-31T00:28:19.084 INFO:teuthology.orchestra.run.smithi077.stdout:Install 7 Packages 2023-08-31T00:28:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2023-08-31T00:28:19.085 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.3 M 2023-08-31T00:28:19.085 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2023-08-31T00:28:19.501 INFO:teuthology.orchestra.run.smithi077.stdout:(1/9): dump-0.4-0.36.b46.el8.x86_64.rpm 662 kB/s | 164 kB 00:00 2023-08-31T00:28:19.535 INFO:teuthology.orchestra.run.smithi077.stdout:(2/9): rmt-1.5.3-13.el8.x86_64.rpm 189 kB/s | 51 kB 00:00 2023-08-31T00:28:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:(3/9): indent-2.2.13-2.el8.x86_64.rpm 562 kB/s | 187 kB 00:00 2023-08-31T00:28:19.811 INFO:teuthology.orchestra.run.smithi077.stdout:(4/9): fio-3.19-3.el8.x86_64.rpm 2.3 MB/s | 538 kB 00:00 2023-08-31T00:28:19.927 INFO:teuthology.orchestra.run.smithi077.stdout:(5/9): daxctl-libs-71.1-3.el8.x86_64.rpm 98 kB/s | 42 kB 00:00 2023-08-31T00:28:19.953 INFO:teuthology.orchestra.run.smithi077.stdout:(6/9): ndctl-libs-71.1-3.el8.x86_64.rpm 184 kB/s | 79 kB 00:00 2023-08-31T00:28:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:(7/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2023-08-31T00:28:20.170 INFO:teuthology.orchestra.run.smithi077.stdout:(8/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 2.7 MB/s | 668 kB 00:00 2023-08-31T00:28:20.195 INFO:teuthology.orchestra.run.smithi077.stdout:(9/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 239 kB/s | 92 kB 00:00 2023-08-31T00:28:20.196 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2023-08-31T00:28:20.197 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.1 MB/s | 2.3 MB 00:01 2023-08-31T00:28:20.291 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2023-08-31T00:28:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2023-08-31T00:28:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2023-08-31T00:28:20.413 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2023-08-31T00:28:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2023-08-31T00:28:20.826 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2023-08-31T00:28:20.997 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-08-31T00:28:21.073 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-08-31T00:28:21.297 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-08-31T00:28:21.368 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-08-31T00:28:21.539 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-31T00:28:21.673 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-08-31T00:28:21.854 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-08-31T00:28:22.047 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-08-31T00:28:22.286 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-08-31T00:28:22.614 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-08-31T00:28:22.925 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-08-31T00:28:23.114 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : indent-2.2.13-2.el8.x86_64 9/11 2023-08-31T00:28:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-08-31T00:28:23.445 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-31T00:28:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-31T00:28:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/11 2023-08-31T00:28:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/11 2023-08-31T00:28:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/11 2023-08-31T00:28:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/11 2023-08-31T00:28:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/11 2023-08-31T00:28:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-3.19-3.el8.x86_64 6/11 2023-08-31T00:28:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 7/11 2023-08-31T00:28:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-08-31T00:28:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-08-31T00:28:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-08-31T00:28:24.917 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-08-31T00:28:24.918 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:04:38 ago on Thu 31 Aug 2023 12:23:46 AM UTC. 2023-08-31T00:28:27.133 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:28:27.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:28:30.993 INFO:teuthology.orchestra.run.smithi077.stdout:Installed products updated. 2023-08-31T00:28:31.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:31.183 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2023-08-31T00:28:31.183 INFO:teuthology.orchestra.run.smithi077.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-08-31T00:28:31.184 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2023-08-31T00:28:31.184 INFO:teuthology.orchestra.run.smithi077.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-08-31T00:28:31.184 INFO:teuthology.orchestra.run.smithi077.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-2.el8.x86_64 2023-08-31T00:28:31.184 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-08-31T00:28:31.184 INFO:teuthology.orchestra.run.smithi077.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-08-31T00:28:31.185 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:31.185 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2023-08-31T00:28:31.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd -m fsgqa 2023-08-31T00:28:31.358 INFO:teuthology.orchestra.run.smithi077.stderr:useradd: user 'fsgqa' already exists 2023-08-31T00:28:31.359 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-31T00:28:31.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo groupadd fsgqa 2023-08-31T00:28:31.427 INFO:teuthology.orchestra.run.smithi077.stderr:groupadd: group 'fsgqa' already exists 2023-08-31T00:28:31.428 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-08-31T00:28:31.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd fsgqa2 2023-08-31T00:28:32.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd 123456-fsgqa 2023-08-31T00:28:33.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-08-31T00:28:33.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 -- 172.21.15.77:0/2060984424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e00cbfd0 msgr2=0x7f91e00cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 --2- 172.21.15.77:0/2060984424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e00cbfd0 0x7f91e00cc420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f91e00d2360 tx=0x7f91d0009c70 comp rx=0 tx=0).stop 2023-08-31T00:28:33.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 -- 172.21.15.77:0/2060984424 shutdown_connections 2023-08-31T00:28:33.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 --2- 172.21.15.77:0/2060984424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e00cbfd0 0x7f91e00cc420 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 --2- 172.21.15.77:0/2060984424 >> v2:172.21.15.139:3300/0 conn(0x7f91e00b6f50 0x7f91e00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 -- 172.21.15.77:0/2060984424 >> 172.21.15.77:0/2060984424 conn(0x7f91e0071660 msgr2=0x7f91e0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:33.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 -- 172.21.15.77:0/2060984424 shutdown_connections 2023-08-31T00:28:33.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.515+0000 7f91e55db700 1 -- 172.21.15.77:0/2060984424 wait complete. 2023-08-31T00:28:33.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.516+0000 7f91e55db700 1 Processor -- start 2023-08-31T00:28:33.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.516+0000 7f91e55db700 1 -- start start 2023-08-31T00:28:33.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91e55db700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e00b6f50 0x7f91e014ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91e55db700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f91e00cbfd0 0x7f91e00b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91e55db700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 0x7f91e00b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91e55db700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01e6a60 con 0x7f91e015b560 2023-08-31T00:28:33.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91e55db700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01e59c0 con 0x7f91e00b6f50 2023-08-31T00:28:33.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91e55db700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e01e5ca0 con 0x7f91e00cbfd0 2023-08-31T00:28:33.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 0x7f91e00b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:33.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 0x7f91e00b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41048/0 (socket says 172.21.15.77:41048) 2023-08-31T00:28:33.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 -- 172.21.15.77:0/861968024 learned_addr learned my addr 172.21.15.77:0/861968024 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:33.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 -- 172.21.15.77:0/861968024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f91e00cbfd0 msgr2=0x7f91e00b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f91e00cbfd0 0x7f91e00b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 -- 172.21.15.77:0/861968024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e00b6f50 msgr2=0x7f91e014ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e00b6f50 0x7f91e014ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.517+0000 7f91df7fe700 1 -- 172.21.15.77:0/861968024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d00095f0 con 0x7f91e015b560 2023-08-31T00:28:33.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.518+0000 7f91df7fe700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 0x7f91e00b5140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005fd0 tx=0x7f91d000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:33.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.518+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d001d070 con 0x7f91e015b560 2023-08-31T00:28:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.518+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91d0003890 con 0x7f91e015b560 2023-08-31T00:28:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.518+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e01e5f80 con 0x7f91e015b560 2023-08-31T00:28:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.518+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0003cc0 con 0x7f91e015b560 2023-08-31T00:28:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.518+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e01e6540 con 0x7f91e015b560 2023-08-31T00:28:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.519+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e01e66d0 con 0x7f91e015b560 2023-08-31T00:28:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.519+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91d000f460 con 0x7f91e015b560 2023-08-31T00:28:33.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.520+0000 7f91d77fe700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f91c006a0e0 0x7f91c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.520+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91d0089be0 con 0x7f91e015b560 2023-08-31T00:28:33.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.520+0000 7f91deffd700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f91c006a0e0 0x7f91c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:33.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.520+0000 7f91deffd700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f91c006a0e0 0x7f91c006c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f91d80012e0 tx=0x7f91d80016e0 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:33.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.524+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91d0055570 con 0x7f91e015b560 2023-08-31T00:28:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.797+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f91e0073c30 con 0x7f91e015b560 2023-08-31T00:28:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.797+0000 7f91d77fe700 1 -- 172.21.15.77:0/861968024 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f91d0027090 con 0x7f91e015b560 2023-08-31T00:28:33.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:28:33.799 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":1,"fsid":"cd1ac960-5b19-4e71-9e49-9da190b0a8ec","modified":"2023-08-31T00:25:58.784254Z","created":"2023-08-31T00:25:58.784254Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-08-31T00:28:33.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.799+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f91c006a0e0 msgr2=0x7f91c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.799+0000 7f91e55db700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f91c006a0e0 0x7f91c006c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f91d80012e0 tx=0x7f91d80016e0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 msgr2=0x7f91e00b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 0x7f91e00b5140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005fd0 tx=0x7f91d000bed0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 shutdown_connections 2023-08-31T00:28:33.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f91c006a0e0 0x7f91c006c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e015b560 0x7f91e00b5140 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e00b6f50 0x7f91e014ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 --2- 172.21.15.77:0/861968024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f91e00cbfd0 0x7f91e00b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 >> 172.21.15.77:0/861968024 conn(0x7f91e0071660 msgr2=0x7f91e01526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:33.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 shutdown_connections 2023-08-31T00:28:33.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.800+0000 7f91e55db700 1 -- 172.21.15.77:0/861968024 wait complete. 2023-08-31T00:28:33.803 INFO:teuthology.orchestra.run.smithi077.stderr:dumped monmap epoch 1 2023-08-31T00:28:33.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-08-31T00:28:33.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 -- 172.21.15.77:0/2655579123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f409015bce0 msgr2=0x7f409015c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 --2- 172.21.15.77:0/2655579123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f409015bce0 0x7f409015c170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4088009f60 tx=0x7f4088009f90 comp rx=0 tx=0).stop 2023-08-31T00:28:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 -- 172.21.15.77:0/2655579123 shutdown_connections 2023-08-31T00:28:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 --2- 172.21.15.77:0/2655579123 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f409015bce0 0x7f409015c170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 --2- 172.21.15.77:0/2655579123 >> v2:172.21.15.139:3300/0 conn(0x7f409006e3c0 0x7f409006e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 -- 172.21.15.77:0/2655579123 >> 172.21.15.77:0/2655579123 conn(0x7f40900afbf0 msgr2=0x7f40900b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:33.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 -- 172.21.15.77:0/2655579123 shutdown_connections 2023-08-31T00:28:33.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.957+0000 7f409718d700 1 -- 172.21.15.77:0/2655579123 wait complete. 2023-08-31T00:28:33.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.958+0000 7f409718d700 1 Processor -- start 2023-08-31T00:28:33.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.958+0000 7f409718d700 1 -- start start 2023-08-31T00:28:33.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f409718d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 0x7f409014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f409718d700 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4090158210 0x7f40901f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f409718d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f409015bce0 0x7f40900b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f409718d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900c80c0 con 0x7f409006e3c0 2023-08-31T00:28:33.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f409718d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409014c590 con 0x7f409015bce0 2023-08-31T00:28:33.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f409718d700 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40901f2980 con 0x7f4090158210 2023-08-31T00:28:33.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f4094f29700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 0x7f409014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:33.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f4094f29700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 0x7f409014c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41058/0 (socket says 172.21.15.77:41058) 2023-08-31T00:28:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.959+0000 7f4094f29700 1 -- 172.21.15.77:0/3301026460 learned_addr learned my addr 172.21.15.77:0/3301026460 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-08-31T00:28:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f408ffff700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4090158210 0x7f40901f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f409572a700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f409015bce0 0x7f40900b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f4094f29700 1 -- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4090158210 msgr2=0x7f40901f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f4094f29700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4090158210 0x7f40901f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f4094f29700 1 -- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f409015bce0 msgr2=0x7f40900b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f4094f29700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f409015bce0 0x7f40900b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f4094f29700 1 -- 172.21.15.77:0/3301026460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c009520 con 0x7f409006e3c0 2023-08-31T00:28:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f409572a700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f409015bce0 0x7f40900b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T00:28:33.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f4094f29700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 0x7f409014c050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f408400c730 tx=0x7f408400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:33.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084005230 con 0x7f409006e3c0 2023-08-31T00:28:33.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4084005480 con 0x7f409006e3c0 2023-08-31T00:28:33.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4088009c40 con 0x7f409006e3c0 2023-08-31T00:28:33.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084004970 con 0x7f409006e3c0 2023-08-31T00:28:33.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.960+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40901f1c40 con 0x7f409006e3c0 2023-08-31T00:28:33.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.961+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4090073c30 con 0x7f409006e3c0 2023-08-31T00:28:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.962+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4084004ad0 con 0x7f409006e3c0 2023-08-31T00:28:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.962+0000 7f408d7fa700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f407406a0e0 0x7f407406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T00:28:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.962+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4084087ba0 con 0x7f409006e3c0 2023-08-31T00:28:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.962+0000 7f408ffff700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f407406a0e0 0x7f407406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T00:28:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.962+0000 7f408ffff700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f407406a0e0 0x7f407406c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40900ad7d0 tx=0x7f407c009260 comp rx=0 tx=0).ready entity=mgr.4209 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T00:28:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:33.970+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4084053380 con 0x7f409006e3c0 2023-08-31T00:28:34.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.239+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f40900cb930 con 0x7f409006e3c0 2023-08-31T00:28:34.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.240+0000 7f408d7fa700 1 -- 172.21.15.77:0/3301026460 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v15) v1 ==== 82+0+151 (secure 0 0 0) 0x7f4084017020 con 0x7f409006e3c0 2023-08-31T00:28:34.241 INFO:teuthology.orchestra.run.smithi077.stdout:[client.admin] 2023-08-31T00:28:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAX3u9k0fCpABAAkrs9oz2QYpFCPDt23ZGOSA== 2023-08-31T00:28:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow *" 2023-08-31T00:28:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: caps mgr = "allow *" 2023-08-31T00:28:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow *" 2023-08-31T00:28:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow *" 2023-08-31T00:28:34.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f407406a0e0 msgr2=0x7f407406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:34.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f407406a0e0 0x7f407406c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40900ad7d0 tx=0x7f407c009260 comp rx=0 tx=0).stop 2023-08-31T00:28:34.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 msgr2=0x7f409014c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T00:28:34.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 0x7f409014c050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f408400c730 tx=0x7f408400caf0 comp rx=0 tx=0).stop 2023-08-31T00:28:34.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 shutdown_connections 2023-08-31T00:28:34.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:6832/3314313596,v1:172.21.15.77:6833/3314313596] conn(0x7f407406a0e0 0x7f407406c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:34.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f409015bce0 0x7f40900b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:34.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f409006e3c0 0x7f409014c050 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:34.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 --2- 172.21.15.77:0/3301026460 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4090158210 0x7f40901f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T00:28:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 >> 172.21.15.77:0/3301026460 conn(0x7f40900afbf0 msgr2=0x7f40900c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T00:28:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 shutdown_connections 2023-08-31T00:28:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-08-31T00:28:34.242+0000 7f409718d700 1 -- 172.21.15.77:0/3301026460 wait complete. 2023-08-31T00:28:34.254 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2023-08-31T00:28:34.272 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.W7pwOWr1H8 2023-08-31T00:28:34.272 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:28:34.272 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/tmp/tmp.W7pwOWr1H8 2023-08-31T00:28:34.329 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:28:34.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/tmp/tmp.iDdVgFzsFDxfstests-dev/local.config 2023-08-31T00:28:34.407 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.8SsQQTYHahtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.FA4yhEzqpDscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.77:6789 -k /tmp/tmp.W7pwOWr1H8 --client_mountpoint /test" 2023-08-31T00:28:34.408 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-08-31T00:28:34.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/tmp/tmp.iDdVgFzsFDxfstests-dev/ceph.exclude 2023-08-31T00:28:34.474 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo make) 2023-08-31T00:28:34.551 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize -cfi 2023-08-31T00:28:34.906 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: putting auxiliary files in '.'. 2023-08-31T00:28:34.907 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './config.guess' 2023-08-31T00:28:34.909 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './config.sub' 2023-08-31T00:28:34.913 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './install-sh' 2023-08-31T00:28:34.917 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './ltmain.sh' 2023-08-31T00:28:34.937 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-08-31T00:28:34.937 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-08-31T00:28:34.941 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-08-31T00:28:34.946 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-08-31T00:28:34.950 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-08-31T00:28:34.955 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-08-31T00:28:34.960 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-08-31T00:28:34.961 INFO:teuthology.orchestra.run.smithi077.stdout:cp include/install-sh . 2023-08-31T00:28:34.962 INFO:teuthology.orchestra.run.smithi077.stdout:aclocal -I m4 2023-08-31T00:28:36.107 INFO:teuthology.orchestra.run.smithi077.stdout:autoheader 2023-08-31T00:28:36.407 INFO:teuthology.orchestra.run.smithi077.stdout:autoconf 2023-08-31T00:28:36.565 INFO:teuthology.orchestra.run.smithi077.stdout:./configure \ 2023-08-31T00:28:36.565 INFO:teuthology.orchestra.run.smithi077.stdout: --libexecdir=/usr/lib \ 2023-08-31T00:28:36.566 INFO:teuthology.orchestra.run.smithi077.stdout: --exec_prefix=/var/lib 2023-08-31T00:28:36.978 INFO:teuthology.orchestra.run.smithi077.stdout:checking build system type... x86_64-pc-linux-gnu 2023-08-31T00:28:36.979 INFO:teuthology.orchestra.run.smithi077.stdout:checking host system type... x86_64-pc-linux-gnu 2023-08-31T00:28:36.980 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to print strings... printf 2023-08-31T00:28:36.980 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc... gcc 2023-08-31T00:28:37.114 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether the C compiler works... yes 2023-08-31T00:28:37.114 INFO:teuthology.orchestra.run.smithi077.stdout:checking for C compiler default output file name... a.out 2023-08-31T00:28:37.141 INFO:teuthology.orchestra.run.smithi077.stdout:checking for suffix of executables... 2023-08-31T00:28:37.220 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are cross compiling... no 2023-08-31T00:28:37.237 INFO:teuthology.orchestra.run.smithi077.stdout:checking for suffix of object files... o 2023-08-31T00:28:37.253 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are using the GNU C compiler... yes 2023-08-31T00:28:37.269 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc accepts -g... yes 2023-08-31T00:28:37.296 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to accept ISO C89... none needed 2023-08-31T00:28:37.298 INFO:teuthology.orchestra.run.smithi077.stdout:checking for a sed that does not truncate output... /bin/sed 2023-08-31T00:28:37.300 INFO:teuthology.orchestra.run.smithi077.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-08-31T00:28:37.301 INFO:teuthology.orchestra.run.smithi077.stdout:checking for egrep... /bin/grep -E 2023-08-31T00:28:37.302 INFO:teuthology.orchestra.run.smithi077.stdout:checking for fgrep... /bin/grep -F 2023-08-31T00:28:37.306 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ld used by gcc... /bin/ld 2023-08-31T00:28:37.307 INFO:teuthology.orchestra.run.smithi077.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-08-31T00:28:37.319 INFO:teuthology.orchestra.run.smithi077.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-08-31T00:28:37.335 INFO:teuthology.orchestra.run.smithi077.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-08-31T00:28:37.335 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether ln -s works... yes 2023-08-31T00:28:37.346 INFO:teuthology.orchestra.run.smithi077.stdout:checking the maximum length of command line arguments... 1572864 2023-08-31T00:28:37.349 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-08-31T00:28:37.349 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-08-31T00:28:37.349 INFO:teuthology.orchestra.run.smithi077.stdout:checking for /bin/ld option to reload object files... -r 2023-08-31T00:28:37.349 INFO:teuthology.orchestra.run.smithi077.stdout:checking for objdump... objdump 2023-08-31T00:28:37.350 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to recognize dependent libraries... pass_all 2023-08-31T00:28:37.351 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dlltool... no 2023-08-31T00:28:37.351 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-08-31T00:28:37.351 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ar... ar 2023-08-31T00:28:37.372 INFO:teuthology.orchestra.run.smithi077.stdout:checking for archiver @FILE support... @ 2023-08-31T00:28:37.372 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strip... strip 2023-08-31T00:28:37.373 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ranlib... ranlib 2023-08-31T00:28:37.373 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gawk... gawk 2023-08-31T00:28:37.423 INFO:teuthology.orchestra.run.smithi077.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-08-31T00:28:37.424 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sysroot... no 2023-08-31T00:28:37.427 INFO:teuthology.orchestra.run.smithi077.stdout:checking for a working dd... /bin/dd 2023-08-31T00:28:37.429 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-08-31T00:28:37.442 INFO:teuthology.orchestra.run.smithi077.stdout:checking for mt... no 2023-08-31T00:28:37.444 INFO:teuthology.orchestra.run.smithi077.stdout:checking if : is a manifest tool... no 2023-08-31T00:28:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to run the C preprocessor... gcc -E 2023-08-31T00:28:37.615 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ANSI C header files... yes 2023-08-31T00:28:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/types.h... yes 2023-08-31T00:28:37.678 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/stat.h... yes 2023-08-31T00:28:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:checking for stdlib.h... yes 2023-08-31T00:28:37.724 INFO:teuthology.orchestra.run.smithi077.stdout:checking for string.h... yes 2023-08-31T00:28:37.748 INFO:teuthology.orchestra.run.smithi077.stdout:checking for memory.h... yes 2023-08-31T00:28:37.771 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strings.h... yes 2023-08-31T00:28:37.797 INFO:teuthology.orchestra.run.smithi077.stdout:checking for inttypes.h... yes 2023-08-31T00:28:37.821 INFO:teuthology.orchestra.run.smithi077.stdout:checking for stdint.h... yes 2023-08-31T00:28:37.855 INFO:teuthology.orchestra.run.smithi077.stdout:checking for unistd.h... yes 2023-08-31T00:28:37.880 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dlfcn.h... yes 2023-08-31T00:28:37.883 INFO:teuthology.orchestra.run.smithi077.stdout:checking for objdir... .libs 2023-08-31T00:28:37.947 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-08-31T00:28:37.947 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-08-31T00:28:37.963 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-08-31T00:28:37.982 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc static flag -static works... no 2023-08-31T00:28:38.002 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -c -o file.o... yes 2023-08-31T00:28:38.002 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-08-31T00:28:38.008 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-08-31T00:28:38.032 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether -lc should be explicitly linked in... no 2023-08-31T00:28:38.075 INFO:teuthology.orchestra.run.smithi077.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-08-31T00:28:38.076 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to hardcode library paths into programs... immediate 2023-08-31T00:28:38.078 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether stripping libraries is possible... yes 2023-08-31T00:28:38.078 INFO:teuthology.orchestra.run.smithi077.stdout:checking if libtool supports shared libraries... yes 2023-08-31T00:28:38.078 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether to build shared libraries... yes 2023-08-31T00:28:38.078 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether to build static libraries... yes 2023-08-31T00:28:38.082 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc... (cached) gcc 2023-08-31T00:28:38.098 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-08-31T00:28:38.098 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc accepts -g... (cached) yes 2023-08-31T00:28:38.098 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-08-31T00:28:38.098 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gmake... /usr/bin/gmake 2023-08-31T00:28:38.099 INFO:teuthology.orchestra.run.smithi077.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-08-31T00:28:38.100 INFO:teuthology.orchestra.run.smithi077.stdout:checking for tar... /bin/tar 2023-08-31T00:28:38.100 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gzip... /bin/gzip 2023-08-31T00:28:38.105 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc -MM is supported... yes 2023-08-31T00:28:38.107 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sort... /bin/sort 2023-08-31T00:28:38.107 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether ln -s works... yes 2023-08-31T00:28:38.107 INFO:teuthology.orchestra.run.smithi077.stdout:checking for rpm... /bin/rpm 2023-08-31T00:28:38.110 INFO:teuthology.orchestra.run.smithi077.stdout:checking for rpmbuild... no 2023-08-31T00:28:38.134 INFO:teuthology.orchestra.run.smithi077.stdout:checking assert.h usability... yes 2023-08-31T00:28:38.140 INFO:teuthology.orchestra.run.smithi077.stdout:checking assert.h presence... yes 2023-08-31T00:28:38.141 INFO:teuthology.orchestra.run.smithi077.stdout:checking for assert.h... yes 2023-08-31T00:28:38.166 INFO:teuthology.orchestra.run.smithi077.stdout:checking bstring.h usability... no 2023-08-31T00:28:38.175 INFO:teuthology.orchestra.run.smithi077.stdout:checking bstring.h presence... no 2023-08-31T00:28:38.175 INFO:teuthology.orchestra.run.smithi077.stdout:checking for bstring.h... no 2023-08-31T00:28:38.199 INFO:teuthology.orchestra.run.smithi077.stdout:checking libgen.h usability... yes 2023-08-31T00:28:38.205 INFO:teuthology.orchestra.run.smithi077.stdout:checking libgen.h presence... yes 2023-08-31T00:28:38.206 INFO:teuthology.orchestra.run.smithi077.stdout:checking for libgen.h... yes 2023-08-31T00:28:38.232 INFO:teuthology.orchestra.run.smithi077.stdout:checking dirent.h usability... yes 2023-08-31T00:28:38.240 INFO:teuthology.orchestra.run.smithi077.stdout:checking dirent.h presence... yes 2023-08-31T00:28:38.240 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dirent.h... yes 2023-08-31T00:28:38.283 INFO:teuthology.orchestra.run.smithi077.stdout:checking errno.h usability... yes 2023-08-31T00:28:38.290 INFO:teuthology.orchestra.run.smithi077.stdout:checking errno.h presence... yes 2023-08-31T00:28:38.290 INFO:teuthology.orchestra.run.smithi077.stdout:checking for errno.h... yes 2023-08-31T00:28:38.317 INFO:teuthology.orchestra.run.smithi077.stdout:checking malloc.h usability... yes 2023-08-31T00:28:38.325 INFO:teuthology.orchestra.run.smithi077.stdout:checking malloc.h presence... yes 2023-08-31T00:28:38.325 INFO:teuthology.orchestra.run.smithi077.stdout:checking for malloc.h... yes 2023-08-31T00:28:38.350 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid.h usability... no 2023-08-31T00:28:38.359 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid.h presence... no 2023-08-31T00:28:38.360 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid.h... no 2023-08-31T00:28:38.385 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid/uuid.h usability... yes 2023-08-31T00:28:38.393 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid/uuid.h presence... yes 2023-08-31T00:28:38.394 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid/uuid.h... yes 2023-08-31T00:28:38.420 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/uuid.h usability... no 2023-08-31T00:28:38.429 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/uuid.h presence... no 2023-08-31T00:28:38.429 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/uuid.h... no 2023-08-31T00:28:38.454 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/file.h usability... yes 2023-08-31T00:28:38.461 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/file.h presence... yes 2023-08-31T00:28:38.461 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/file.h... yes 2023-08-31T00:28:38.488 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fcntl.h usability... yes 2023-08-31T00:28:38.496 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fcntl.h presence... yes 2023-08-31T00:28:38.496 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fcntl.h... yes 2023-08-31T00:28:38.521 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/syssgi.h usability... no 2023-08-31T00:28:38.530 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/syssgi.h presence... no 2023-08-31T00:28:38.530 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/syssgi.h... no 2023-08-31T00:28:38.585 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/param.h usability... yes 2023-08-31T00:28:38.595 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/param.h presence... yes 2023-08-31T00:28:38.595 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/param.h... yes 2023-08-31T00:28:38.600 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/stat.h... (cached) yes 2023-08-31T00:28:38.630 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/statvfs.h usability... yes 2023-08-31T00:28:38.637 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/statvfs.h presence... yes 2023-08-31T00:28:38.637 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/statvfs.h... yes 2023-08-31T00:28:38.663 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/time.h usability... yes 2023-08-31T00:28:38.670 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/time.h presence... yes 2023-08-31T00:28:38.670 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/time.h... yes 2023-08-31T00:28:38.704 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/ioctl.h usability... yes 2023-08-31T00:28:38.711 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/ioctl.h presence... yes 2023-08-31T00:28:38.712 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/ioctl.h... yes 2023-08-31T00:28:38.740 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/wait.h usability... yes 2023-08-31T00:28:38.748 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/wait.h presence... yes 2023-08-31T00:28:38.748 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/wait.h... yes 2023-08-31T00:28:38.753 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/types.h... (cached) yes 2023-08-31T00:28:38.757 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strings.h... (cached) yes 2023-08-31T00:28:38.784 INFO:teuthology.orchestra.run.smithi077.stdout:checking err.h usability... yes 2023-08-31T00:28:38.790 INFO:teuthology.orchestra.run.smithi077.stdout:checking err.h presence... yes 2023-08-31T00:28:38.791 INFO:teuthology.orchestra.run.smithi077.stdout:checking for err.h... yes 2023-08-31T00:28:38.817 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/falloc.h usability... yes 2023-08-31T00:28:38.823 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/falloc.h presence... yes 2023-08-31T00:28:38.824 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/falloc.h... yes 2023-08-31T00:28:38.849 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-08-31T00:28:38.858 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-08-31T00:28:38.858 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fs/xfs_fsops.h... no 2023-08-31T00:28:38.881 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_itable.h usability... no 2023-08-31T00:28:38.890 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_itable.h presence... no 2023-08-31T00:28:38.890 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fs/xfs_itable.h... no 2023-08-31T00:28:38.913 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/platform_defs.h usability... no 2023-08-31T00:28:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/platform_defs.h presence... no 2023-08-31T00:28:38.922 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/platform_defs.h... no 2023-08-31T00:28:38.945 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfs/ioctl.h usability... no 2023-08-31T00:28:38.954 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfs/ioctl.h presence... no 2023-08-31T00:28:38.954 INFO:teuthology.orchestra.run.smithi077.stdout:checking for btrfs/ioctl.h... no 2023-08-31T00:28:38.977 INFO:teuthology.orchestra.run.smithi077.stdout:checking cifs/ioctl.h usability... no 2023-08-31T00:28:38.986 INFO:teuthology.orchestra.run.smithi077.stdout:checking cifs/ioctl.h presence... no 2023-08-31T00:28:38.986 INFO:teuthology.orchestra.run.smithi077.stdout:checking for cifs/ioctl.h... no 2023-08-31T00:28:39.011 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/mman.h usability... yes 2023-08-31T00:28:39.018 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/mman.h presence... yes 2023-08-31T00:28:39.018 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/mman.h... yes 2023-08-31T00:28:39.033 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xfs_log_format.h... no 2023-08-31T00:28:39.066 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid_compare... no 2023-08-31T00:28:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid_compare in -luuid... yes 2023-08-31T00:28:39.164 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xfs.h... yes 2023-08-31T00:28:39.177 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/libxfs.h... no 2023-08-31T00:28:39.192 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether xlog_assign_lsn is declared... no 2023-08-31T00:28:39.218 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xqm.h... yes 2023-08-31T00:28:39.262 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfsctl from xfs/xfs.h... ok 2023-08-31T00:28:39.284 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/handle.h usability... yes 2023-08-31T00:28:39.291 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/handle.h presence... yes 2023-08-31T00:28:39.291 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/handle.h... yes 2023-08-31T00:28:39.325 INFO:teuthology.orchestra.run.smithi077.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-08-31T00:28:39.361 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/acl.h usability... yes 2023-08-31T00:28:39.369 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/acl.h presence... yes 2023-08-31T00:28:39.369 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/acl.h... yes 2023-08-31T00:28:39.398 INFO:teuthology.orchestra.run.smithi077.stdout:checking acl/libacl.h usability... yes 2023-08-31T00:28:39.406 INFO:teuthology.orchestra.run.smithi077.stdout:checking acl/libacl.h presence... yes 2023-08-31T00:28:39.406 INFO:teuthology.orchestra.run.smithi077.stdout:checking for acl/libacl.h... yes 2023-08-31T00:28:39.436 INFO:teuthology.orchestra.run.smithi077.stdout:checking for acl_init in -lacl... yes 2023-08-31T00:28:39.458 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm-ndbm.h usability... no 2023-08-31T00:28:39.469 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm-ndbm.h presence... no 2023-08-31T00:28:39.469 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gdbm-ndbm.h... no 2023-08-31T00:28:39.532 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm/ndbm.h usability... no 2023-08-31T00:28:39.542 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm/ndbm.h presence... no 2023-08-31T00:28:39.542 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gdbm/ndbm.h... no 2023-08-31T00:28:39.562 INFO:teuthology.orchestra.run.smithi077.stdout:checking ndbm.h usability... no 2023-08-31T00:28:39.571 INFO:teuthology.orchestra.run.smithi077.stdout:checking ndbm.h presence... no 2023-08-31T00:28:39.571 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ndbm.h... no 2023-08-31T00:28:39.595 INFO:teuthology.orchestra.run.smithi077.stdout:checking libaio.h usability... yes 2023-08-31T00:28:39.605 INFO:teuthology.orchestra.run.smithi077.stdout:checking libaio.h presence... yes 2023-08-31T00:28:39.605 INFO:teuthology.orchestra.run.smithi077.stdout:checking for libaio.h... yes 2023-08-31T00:28:39.627 INFO:teuthology.orchestra.run.smithi077.stdout:checking liburing.h usability... no 2023-08-31T00:28:39.636 INFO:teuthology.orchestra.run.smithi077.stdout:checking liburing.h presence... no 2023-08-31T00:28:39.636 INFO:teuthology.orchestra.run.smithi077.stdout:checking for liburing.h... no 2023-08-31T00:28:39.656 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/capability.h usability... no 2023-08-31T00:28:39.666 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/capability.h presence... no 2023-08-31T00:28:39.666 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/capability.h... no 2023-08-31T00:28:39.688 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fiemap.h usability... yes 2023-08-31T00:28:39.695 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fiemap.h presence... yes 2023-08-31T00:28:39.695 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/fiemap.h... yes 2023-08-31T00:28:39.726 INFO:teuthology.orchestra.run.smithi077.stdout:checking for fallocate... yes 2023-08-31T00:28:39.758 INFO:teuthology.orchestra.run.smithi077.stdout:checking for open_by_handle_at... yes 2023-08-31T00:28:39.782 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/prctl.h usability... yes 2023-08-31T00:28:39.789 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/prctl.h presence... yes 2023-08-31T00:28:39.789 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/prctl.h... yes 2023-08-31T00:28:39.812 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fs.h usability... yes 2023-08-31T00:28:39.819 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fs.h presence... yes 2023-08-31T00:28:39.819 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/fs.h... yes 2023-08-31T00:28:39.840 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfsutil.h usability... no 2023-08-31T00:28:39.849 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfsutil.h presence... no 2023-08-31T00:28:39.849 INFO:teuthology.orchestra.run.smithi077.stdout:checking for btrfsutil.h... no 2023-08-31T00:28:39.883 INFO:teuthology.orchestra.run.smithi077.stdout:checking for copy_file_range... yes 2023-08-31T00:28:39.916 INFO:teuthology.orchestra.run.smithi077.stdout:checking for SEEK_DATA... yes 2023-08-31T00:28:39.960 INFO:teuthology.orchestra.run.smithi077.stdout:checking for BMV_OF_SHARED... yes 2023-08-31T00:28:39.995 INFO:teuthology.orchestra.run.smithi077.stdout:checking for nftw... yes 2023-08-31T00:28:40.028 INFO:teuthology.orchestra.run.smithi077.stdout:checking for RLIMIT_NOFILE... yes 2023-08-31T00:28:40.044 INFO:teuthology.orchestra.run.smithi077.stdout:checking for FIEXCHANGE_RANGE... no 2023-08-31T00:28:40.076 INFO:teuthology.orchestra.run.smithi077.stdout:checking for renameat2... yes 2023-08-31T00:28:40.108 INFO:teuthology.orchestra.run.smithi077.stdout:checking for reallocarray... yes 2023-08-31T00:28:40.121 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct mount_attr... no 2023-08-31T00:28:40.169 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_qgroup_limit... yes 2023-08-31T00:28:40.204 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-08-31T00:28:40.237 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-08-31T00:28:40.270 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-08-31T00:28:40.304 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-08-31T00:28:40.337 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-08-31T00:28:40.370 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-08-31T00:28:40.396 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs.h usability... yes 2023-08-31T00:28:40.403 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs.h presence... yes 2023-08-31T00:28:40.403 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/btrfs.h... yes 2023-08-31T00:28:40.432 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs_tree.h usability... yes 2023-08-31T00:28:40.439 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs_tree.h presence... yes 2023-08-31T00:28:40.439 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/btrfs_tree.h... yes 2023-08-31T00:28:40.469 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-08-31T00:28:40.484 INFO:teuthology.orchestra.run.smithi077.stdout:configure: creating ./config.status 2023-08-31T00:28:40.773 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: creating include/builddefs 2023-08-31T00:28:40.783 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: creating include/config.h 2023-08-31T00:28:40.790 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: executing libtool commands 2023-08-31T00:28:40.827 INFO:teuthology.orchestra.run.smithi077.stdout:Building include 2023-08-31T00:28:40.830 INFO:teuthology.orchestra.run.smithi077.stdout:Building lib 2023-08-31T00:28:40.833 INFO:teuthology.orchestra.run.smithi077.stdout: [LTDEP] 2023-08-31T00:28:40.931 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dataascii.lo 2023-08-31T00:28:41.042 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] databin.lo 2023-08-31T00:28:41.179 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] datapid.lo 2023-08-31T00:28:41.274 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] file_lock.lo 2023-08-31T00:28:41.411 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] forker.lo 2023-08-31T00:28:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] pattern.lo 2023-08-31T00:28:41.648 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] open_flags.lo 2023-08-31T00:28:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] random_range.lo 2023-08-31T00:28:41.984 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] string_to_tokens.lo 2023-08-31T00:28:42.081 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] str_to_bytes.lo 2023-08-31T00:28:42.201 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] tlibio.lo 2023-08-31T00:28:42.414 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] write_log.lo 2023-08-31T00:28:42.630 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] random.lo 2023-08-31T00:28:42.737 INFO:teuthology.orchestra.run.smithi077.stdout: [LD] 2023-08-31T00:28:42.806 INFO:teuthology.orchestra.run.smithi077.stdout:Building ltp 2023-08-31T00:28:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-08-31T00:28:42.916 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] doio 2023-08-31T00:28:43.504 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsstress 2023-08-31T00:28:44.685 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsx 2023-08-31T00:28:45.463 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] growfiles 2023-08-31T00:28:45.919 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] iogen 2023-08-31T00:28:46.238 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-stress 2023-08-31T00:28:46.614 INFO:teuthology.orchestra.run.smithi077.stdout:Building src 2023-08-31T00:28:46.619 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-08-31T00:28:47.926 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-08-31T00:28:47.950 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-08-31T00:28:47.958 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-08-31T00:28:48.135 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-08-31T00:28:48.156 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirstress 2023-08-31T00:28:48.369 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fill 2023-08-31T00:28:48.510 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fill2 2023-08-31T00:28:48.714 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] getpagesize 2023-08-31T00:28:48.837 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] holes 2023-08-31T00:28:49.012 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] lstat64 2023-08-31T00:28:49.178 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] nametest 2023-08-31T00:28:49.392 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] permname 2023-08-31T00:28:49.570 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] randholes 2023-08-31T00:28:49.791 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] runas 2023-08-31T00:28:49.948 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] truncfile 2023-08-31T00:28:50.109 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] usemem 2023-08-31T00:28:50.246 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmapcat 2023-08-31T00:28:50.382 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] append_reader 2023-08-31T00:28:50.519 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] append_writer 2023-08-31T00:28:50.656 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirperf 2023-08-31T00:28:50.854 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] metaperf 2023-08-31T00:28:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] devzero 2023-08-31T00:28:51.239 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] feature 2023-08-31T00:28:51.431 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] alloc 2023-08-31T00:28:51.621 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fault 2023-08-31T00:28:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fstest 2023-08-31T00:28:51.980 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_access_root 2023-08-31T00:28:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] godown 2023-08-31T00:28:52.272 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] resvtest 2023-08-31T00:28:52.438 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] writemod 2023-08-31T00:28:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] writev_on_pagefault 2023-08-31T00:28:52.722 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] makeextents 2023-08-31T00:28:52.884 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] itrash 2023-08-31T00:28:53.025 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] rename 2023-08-31T00:28:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] multi_open_unlink 2023-08-31T00:28:53.303 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] unwritten_sync 2023-08-31T00:28:53.466 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] genhashnames 2023-08-31T00:28:53.635 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_holes 2023-08-31T00:28:53.769 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_writev 2023-08-31T00:28:53.904 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_truncate_cmtime 2023-08-31T00:28:54.048 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirhash_collide 2023-08-31T00:28:54.212 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_rename_overwrite 2023-08-31T00:28:54.342 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] holetest 2023-08-31T00:28:54.539 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_truncate_self 2023-08-31T00:28:54.668 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] af_unix 2023-08-31T00:28:54.807 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_stale_pmd 2023-08-31T00:28:54.946 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_cow_race 2023-08-31T00:28:55.094 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_fallocate 2023-08-31T00:28:55.232 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsync-err 2023-08-31T00:28:55.399 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_write_ro 2023-08-31T00:28:55.543 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ext4_dax_journal_corruption 2023-08-31T00:28:55.686 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ext4_dax_inline_corruption 2023-08-31T00:28:55.829 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ofd_locks 2023-08-31T00:28:56.023 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_collision 2023-08-31T00:28:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmap-write-concurrent 2023-08-31T00:28:56.357 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_get_file_time 2023-08-31T00:28:56.492 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_create_short_dirs 2023-08-31T00:28:56.642 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_create_long_dirs 2023-08-31T00:28:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_enospc 2023-08-31T00:28:56.960 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_writev_overlap 2023-08-31T00:28:57.113 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] checkpoint_journal 2023-08-31T00:28:57.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:28:57.203 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:28:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmap-rw-fault 2023-08-31T00:28:57.421 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] allocstale 2023-08-31T00:28:57.574 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_cow_memory_failure 2023-08-31T00:28:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fake-dump-rootino 2023-08-31T00:28:57.865 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-buf-fault 2023-08-31T00:28:58.006 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] xfsctl 2023-08-31T00:28:58.175 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bstat 2023-08-31T00:28:58.359 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mtab 2023-08-31T00:28:58.526 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] getdevicesize 2023-08-31T00:28:58.656 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] preallo_rw_pattern_reader 2023-08-31T00:28:58.799 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] preallo_rw_pattern_writer 2023-08-31T00:28:58.943 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] ftrunc 2023-08-31T00:28:59.079 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] trunc 2023-08-31T00:28:59.225 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fs_perms 2023-08-31T00:28:59.374 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] testx 2023-08-31T00:28:59.495 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] looptest 2023-08-31T00:28:59.668 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] locktest 2023-08-31T00:28:59.942 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] unwritten_mmap 2023-08-31T00:29:00.090 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_unlink_test 2023-08-31T00:29:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] deduperace 2023-08-31T00:29:00.447 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_unlink_test_modified 2023-08-31T00:29:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_offset 2023-08-31T00:29:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_futimens 2023-08-31T00:29:00.889 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_immutable 2023-08-31T00:29:01.431 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] stale_handle 2023-08-31T00:29:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] pwrite_mmap_blocked 2023-08-31T00:29:01.724 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_offset2 2023-08-31T00:29:01.897 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] seek_sanity_test 2023-08-31T00:29:02.267 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] seek_copy_test 2023-08-31T00:29:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_1 2023-08-31T00:29:02.564 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_2 2023-08-31T00:29:02.702 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsync-tester 2023-08-31T00:29:02.925 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] nsexec 2023-08-31T00:29:03.086 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] cloner 2023-08-31T00:29:03.247 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] renameat2 2023-08-31T00:29:03.397 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_getcwd 2023-08-31T00:29:03.541 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] e4compact 2023-08-31T00:29:03.722 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] test-nextquota 2023-08-31T00:29:03.875 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] punch-alternating 2023-08-31T00:29:04.028 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] attr-list-by-handle-cursor-test 2023-08-31T00:29:04.181 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] listxattr 2023-08-31T00:29:04.316 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-interleaved 2023-08-31T00:29:04.462 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_type 2023-08-31T00:29:04.604 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-invalidate-cache 2023-08-31T00:29:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] stat_test 2023-08-31T00:29:05.053 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_encrypted_d_revalidate 2023-08-31T00:29:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] attr_replace_test 2023-08-31T00:29:05.351 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] swapon 2023-08-31T00:29:05.502 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mkswap 2023-08-31T00:29:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_attr_corruption 2023-08-31T00:29:05.777 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_open_tmpfiles 2023-08-31T00:29:05.939 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fscrypt-crypt-util 2023-08-31T00:29:06.599 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_null_ocount 2023-08-31T00:29:06.744 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] splice-test 2023-08-31T00:29:06.908 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] chprojid_fail 2023-08-31T00:29:07.055 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] detached_mounts_propagation 2023-08-31T00:29:07.222 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] ext4_resize 2023-08-31T00:29:07.357 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_3 2023-08-31T00:29:07.533 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] splice2pipe 2023-08-31T00:29:07.682 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] uuid_ioctl 2023-08-31T00:29:07.823 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fiemap-tester 2023-08-31T00:29:08.062 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_stripealign 2023-08-31T00:29:08.203 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] open_by_handle 2023-08-31T00:29:08.433 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_dio 2023-08-31T00:29:08.581 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] xfsfind 2023-08-31T00:29:08.755 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fssum 2023-08-31T00:29:09.141 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2023-08-31T00:29:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] replay-log 2023-08-31T00:29:09.424 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-08-31T00:29:09.427 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2023-08-31T00:29:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-append-write-fallocate-race 2023-08-31T00:29:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-fcntl-race 2023-08-31T00:29:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-subblock-eof-read 2023-08-31T00:29:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-append-write-read-race 2023-08-31T00:29:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-invalidate-readahead 2023-08-31T00:29:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-write-verify 2023-08-31T00:29:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-08-31T00:29:10.493 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-last-ref-held-by-io 2023-08-31T00:29:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-cycle-write 2023-08-31T00:29:10.823 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-extend-stat 2023-08-31T00:29:10.975 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-08-31T00:29:11.101 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-hole-filling-race 2023-08-31T00:29:11.241 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-invalidate-failure 2023-08-31T00:29:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aiodio_sparse2 2023-08-31T00:29:11.586 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aiocp 2023-08-31T00:29:11.790 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-cow-race 2023-08-31T00:29:11.933 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-eof-race 2023-08-31T00:29:12.102 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2023-08-31T00:29:12.107 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] vfstest 2023-08-31T00:29:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mount-idmapped 2023-08-31T00:29:14.115 INFO:teuthology.orchestra.run.smithi077.stdout:Building m4 2023-08-31T00:29:14.117 INFO:teuthology.orchestra.run.smithi077.stdout:Building common 2023-08-31T00:29:14.121 INFO:teuthology.orchestra.run.smithi077.stdout:Building tests 2023-08-31T00:29:14.126 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-08-31T00:29:14.131 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/perf/group.list 2023-08-31T00:29:14.141 INFO:teuthology.orchestra.run.smithi077.stdout:Building ext4 2023-08-31T00:29:14.146 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ext4/group.list 2023-08-31T00:29:14.182 INFO:teuthology.orchestra.run.smithi077.stdout:Building ocfs2 2023-08-31T00:29:14.184 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ocfs2/group.list 2023-08-31T00:29:14.196 INFO:teuthology.orchestra.run.smithi077.stdout:Building overlay 2023-08-31T00:29:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/overlay/group.list 2023-08-31T00:29:14.235 INFO:teuthology.orchestra.run.smithi077.stdout:Building cifs 2023-08-31T00:29:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/cifs/group.list 2023-08-31T00:29:14.251 INFO:teuthology.orchestra.run.smithi077.stdout:Building generic 2023-08-31T00:29:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/generic/group.list 2023-08-31T00:29:14.346 INFO:teuthology.orchestra.run.smithi077.stdout:Building shared 2023-08-31T00:29:14.350 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/shared/group.list 2023-08-31T00:29:14.365 INFO:teuthology.orchestra.run.smithi077.stdout:Building nfs 2023-08-31T00:29:14.370 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/nfs/group.list 2023-08-31T00:29:14.383 INFO:teuthology.orchestra.run.smithi077.stdout:Building f2fs 2023-08-31T00:29:14.389 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/f2fs/group.list 2023-08-31T00:29:14.403 INFO:teuthology.orchestra.run.smithi077.stdout:Building udf 2023-08-31T00:29:14.408 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/udf/group.list 2023-08-31T00:29:14.418 INFO:teuthology.orchestra.run.smithi077.stdout:Building ceph 2023-08-31T00:29:14.422 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ceph/group.list 2023-08-31T00:29:14.435 INFO:teuthology.orchestra.run.smithi077.stdout:Building xfs 2023-08-31T00:29:14.441 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/xfs/group.list 2023-08-31T00:29:14.531 INFO:teuthology.orchestra.run.smithi077.stdout:Building btrfs 2023-08-31T00:29:14.536 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/btrfs/group.list 2023-08-31T00:29:14.590 INFO:teuthology.orchestra.run.smithi077.stdout:Building tmpfs 2023-08-31T00:29:14.597 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/tmpfs/group.list 2023-08-31T00:29:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:Building selftest 2023-08-31T00:29:14.611 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/selftest/group.list 2023-08-31T00:29:14.624 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo make install) 2023-08-31T00:29:14.661 INFO:teuthology.orchestra.run.smithi077.stdout:Building include 2023-08-31T00:29:14.664 INFO:teuthology.orchestra.run.smithi077.stdout:Building lib 2023-08-31T00:29:14.668 INFO:teuthology.orchestra.run.smithi077.stdout:Building ltp 2023-08-31T00:29:14.671 INFO:teuthology.orchestra.run.smithi077.stdout:Building src 2023-08-31T00:29:14.704 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2023-08-31T00:29:14.707 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-08-31T00:29:14.710 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2023-08-31T00:29:14.714 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2023-08-31T00:29:14.717 INFO:teuthology.orchestra.run.smithi077.stdout:Building m4 2023-08-31T00:29:14.721 INFO:teuthology.orchestra.run.smithi077.stdout:Building common 2023-08-31T00:29:14.724 INFO:teuthology.orchestra.run.smithi077.stdout:Building tests 2023-08-31T00:29:14.729 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-08-31T00:29:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/perf/group.list 2023-08-31T00:29:14.744 INFO:teuthology.orchestra.run.smithi077.stdout:Building ext4 2023-08-31T00:29:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ext4/group.list 2023-08-31T00:29:14.782 INFO:teuthology.orchestra.run.smithi077.stdout:Building ocfs2 2023-08-31T00:29:14.787 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ocfs2/group.list 2023-08-31T00:29:14.798 INFO:teuthology.orchestra.run.smithi077.stdout:Building overlay 2023-08-31T00:29:14.805 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/overlay/group.list 2023-08-31T00:29:14.838 INFO:teuthology.orchestra.run.smithi077.stdout:Building cifs 2023-08-31T00:29:14.843 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/cifs/group.list 2023-08-31T00:29:14.854 INFO:teuthology.orchestra.run.smithi077.stdout:Building generic 2023-08-31T00:29:14.860 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/generic/group.list 2023-08-31T00:29:14.947 INFO:teuthology.orchestra.run.smithi077.stdout:Building shared 2023-08-31T00:29:14.951 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/shared/group.list 2023-08-31T00:29:14.967 INFO:teuthology.orchestra.run.smithi077.stdout:Building nfs 2023-08-31T00:29:14.971 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/nfs/group.list 2023-08-31T00:29:14.984 INFO:teuthology.orchestra.run.smithi077.stdout:Building f2fs 2023-08-31T00:29:14.989 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/f2fs/group.list 2023-08-31T00:29:15.004 INFO:teuthology.orchestra.run.smithi077.stdout:Building udf 2023-08-31T00:29:15.008 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/udf/group.list 2023-08-31T00:29:15.019 INFO:teuthology.orchestra.run.smithi077.stdout:Building ceph 2023-08-31T00:29:15.023 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ceph/group.list 2023-08-31T00:29:15.036 INFO:teuthology.orchestra.run.smithi077.stdout:Building xfs 2023-08-31T00:29:15.043 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/xfs/group.list 2023-08-31T00:29:15.131 INFO:teuthology.orchestra.run.smithi077.stdout:Building btrfs 2023-08-31T00:29:15.136 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/btrfs/group.list 2023-08-31T00:29:15.189 INFO:teuthology.orchestra.run.smithi077.stdout:Building tmpfs 2023-08-31T00:29:15.193 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/tmpfs/group.list 2023-08-31T00:29:15.205 INFO:teuthology.orchestra.run.smithi077.stdout:Building selftest 2023-08-31T00:29:15.210 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/selftest/group.list 2023-08-31T00:29:15.221 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-08-31T00:29:15.222 INFO:teuthology.orchestra.run.smithi077.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-31T00:29:15.222 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-08-31T00:29:15.224 INFO:teuthology.orchestra.run.smithi077.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-31T00:29:15.224 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-08-31T00:29:15.226 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-08-31T00:29:15.235 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-08-31T00:29:15.311 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-08-31T00:29:15.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-08-31T00:29:15.336 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2023-08-31T00:29:15.339 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-08-31T00:29:15.342 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2023-08-31T00:29:15.346 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2023-08-31T00:29:15.349 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C log-writes install 2023-08-31T00:29:15.350 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-08-31T00:29:15.359 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-08-31T00:29:15.368 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C perf install 2023-08-31T00:29:15.369 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-08-31T00:29:15.378 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-08-31T00:29:15.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-08-31T00:29:15.402 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-08-31T00:29:15.410 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-08-31T00:29:15.463 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C vfs install 2023-08-31T00:29:15.464 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-08-31T00:29:15.473 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-08-31T00:29:15.485 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-08-31T00:29:15.493 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-08-31T00:29:16.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-08-31T00:29:16.783 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-08-31T00:29:16.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-08-31T00:29:16.814 INFO:teuthology.orchestra.run.smithi077.stdout:gmake[1]: Nothing to be done for 'install'. 2023-08-31T00:29:16.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-08-31T00:29:16.816 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-08-31T00:29:16.824 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-08-31T00:29:16.957 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-08-31T00:29:16.958 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/btrfs/ install 2023-08-31T00:29:16.961 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-08-31T00:29:16.970 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 /var/lib/xfstests/tests/btrfs 2023-08-31T00:29:17.774 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-08-31T00:29:17.782 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 175.out 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 024.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 173.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 063.out 058.out 113.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 021.out 253.out 255.out 139.out 090.out 221.out 087.out 294.out 212.out 112.out 256.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out /var/lib/xfstests/tests/btrfs 2023-08-31T00:29:18.588 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ceph/ install 2023-08-31T00:29:18.589 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-08-31T00:29:18.598 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-08-31T00:29:18.617 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-08-31T00:29:18.626 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-08-31T00:29:18.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/cifs/ install 2023-08-31T00:29:18.647 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-08-31T00:29:18.655 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-08-31T00:29:18.664 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-08-31T00:29:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-08-31T00:29:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ext4/ install 2023-08-31T00:29:18.683 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-08-31T00:29:18.691 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-08-31T00:29:18.877 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-08-31T00:29:18.886 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-08-31T00:29:19.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/f2fs/ install 2023-08-31T00:29:19.083 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-08-31T00:29:19.092 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-08-31T00:29:19.105 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-08-31T00:29:19.112 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-08-31T00:29:19.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/generic/ install 2023-08-31T00:29:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-08-31T00:29:19.136 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-08-31T00:29:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-08-31T00:29:21.122 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 667.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 075.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-08-31T00:29:23.119 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/nfs/ install 2023-08-31T00:29:23.121 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-08-31T00:29:23.130 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-08-31T00:29:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-08-31T00:29:23.147 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-08-31T00:29:23.155 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/ocfs2/ install 2023-08-31T00:29:23.157 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-08-31T00:29:23.165 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-08-31T00:29:23.174 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-08-31T00:29:23.182 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-08-31T00:29:23.191 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/overlay/ install 2023-08-31T00:29:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-08-31T00:29:23.201 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-08-31T00:29:23.469 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-08-31T00:29:23.478 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 035.out 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 075.out 103.out 033.out 066.out 040.out 056.out /var/lib/xfstests/tests/overlay 2023-08-31T00:29:23.747 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/perf/ install 2023-08-31T00:29:23.749 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-08-31T00:29:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-08-31T00:29:23.766 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-08-31T00:29:23.775 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-08-31T00:29:23.784 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/selftest/ install 2023-08-31T00:29:23.785 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-08-31T00:29:23.793 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-08-31T00:29:23.815 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-08-31T00:29:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-08-31T00:29:23.846 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/shared/ install 2023-08-31T00:29:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-08-31T00:29:23.856 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-08-31T00:29:23.870 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-08-31T00:29:23.878 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-08-31T00:29:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/tmpfs/ install 2023-08-31T00:29:23.894 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-08-31T00:29:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-08-31T00:29:23.911 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-08-31T00:29:23.920 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-08-31T00:29:23.928 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/udf/ install 2023-08-31T00:29:23.930 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-08-31T00:29:23.938 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-08-31T00:29:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-08-31T00:29:23.955 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-08-31T00:29:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.iDdVgFzsFDxfstests-dev/tests/xfs/ install 2023-08-31T00:29:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-08-31T00:29:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-08-31T00:29:25.843 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-08-31T00:29:25.851 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 329.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 544.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out /var/lib/xfstests/tests/xfs 2023-08-31T00:29:27.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:29:27.289 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:29:27.739 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-08-31T00:29:27.748 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-08-31T00:29:27.756 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-08-31T00:29:27.765 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-08-31T00:29:27.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T00:29:27.776 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec ls tests/generic) 2023-08-31T00:29:27.794 INFO:teuthology.orchestra.run.smithi077.stdout:001 2023-08-31T00:29:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:001.out 2023-08-31T00:29:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:002 2023-08-31T00:29:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:002.out 2023-08-31T00:29:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:003 2023-08-31T00:29:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:003.out 2023-08-31T00:29:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:004 2023-08-31T00:29:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:004.out 2023-08-31T00:29:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:005 2023-08-31T00:29:27.796 INFO:teuthology.orchestra.run.smithi077.stdout:005.out 2023-08-31T00:29:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:006 2023-08-31T00:29:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:006.out 2023-08-31T00:29:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:007 2023-08-31T00:29:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:007.out 2023-08-31T00:29:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:008 2023-08-31T00:29:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:008.out 2023-08-31T00:29:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:009 2023-08-31T00:29:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:009.out 2023-08-31T00:29:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:010 2023-08-31T00:29:27.798 INFO:teuthology.orchestra.run.smithi077.stdout:010.out 2023-08-31T00:29:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:011 2023-08-31T00:29:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:011.out 2023-08-31T00:29:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:012 2023-08-31T00:29:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:012.out 2023-08-31T00:29:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:013 2023-08-31T00:29:27.799 INFO:teuthology.orchestra.run.smithi077.stdout:013.out 2023-08-31T00:29:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:014 2023-08-31T00:29:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:014.out 2023-08-31T00:29:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:015 2023-08-31T00:29:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:015.out 2023-08-31T00:29:27.800 INFO:teuthology.orchestra.run.smithi077.stdout:016 2023-08-31T00:29:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:016.out 2023-08-31T00:29:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:017 2023-08-31T00:29:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:017.out 2023-08-31T00:29:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:018 2023-08-31T00:29:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:018.out 2023-08-31T00:29:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:019 2023-08-31T00:29:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:019.out 2023-08-31T00:29:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:020 2023-08-31T00:29:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:020.out 2023-08-31T00:29:27.802 INFO:teuthology.orchestra.run.smithi077.stdout:021 2023-08-31T00:29:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:021.out 2023-08-31T00:29:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:022 2023-08-31T00:29:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:022.out 2023-08-31T00:29:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:023 2023-08-31T00:29:27.803 INFO:teuthology.orchestra.run.smithi077.stdout:023.out 2023-08-31T00:29:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:024 2023-08-31T00:29:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:024.out 2023-08-31T00:29:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:025 2023-08-31T00:29:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:025.out 2023-08-31T00:29:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:026 2023-08-31T00:29:27.804 INFO:teuthology.orchestra.run.smithi077.stdout:026.out 2023-08-31T00:29:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:027 2023-08-31T00:29:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:027.out 2023-08-31T00:29:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:028 2023-08-31T00:29:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:028.out 2023-08-31T00:29:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:029 2023-08-31T00:29:27.805 INFO:teuthology.orchestra.run.smithi077.stdout:029.out 2023-08-31T00:29:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:030 2023-08-31T00:29:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:030.out 2023-08-31T00:29:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:031 2023-08-31T00:29:27.806 INFO:teuthology.orchestra.run.smithi077.stdout:031.out 2023-08-31T00:29:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:032 2023-08-31T00:29:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:032.out 2023-08-31T00:29:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:033 2023-08-31T00:29:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:033.out 2023-08-31T00:29:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:034 2023-08-31T00:29:27.807 INFO:teuthology.orchestra.run.smithi077.stdout:034.out 2023-08-31T00:29:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:035 2023-08-31T00:29:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:035.cfg 2023-08-31T00:29:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:035.out.default 2023-08-31T00:29:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:035.out.nfs 2023-08-31T00:29:27.808 INFO:teuthology.orchestra.run.smithi077.stdout:036 2023-08-31T00:29:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:036.out 2023-08-31T00:29:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:037 2023-08-31T00:29:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:037.out 2023-08-31T00:29:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:038 2023-08-31T00:29:27.809 INFO:teuthology.orchestra.run.smithi077.stdout:038.out 2023-08-31T00:29:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:039 2023-08-31T00:29:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:039.out 2023-08-31T00:29:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:040 2023-08-31T00:29:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:040.out 2023-08-31T00:29:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:041 2023-08-31T00:29:27.810 INFO:teuthology.orchestra.run.smithi077.stdout:041.out 2023-08-31T00:29:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:042 2023-08-31T00:29:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:042.out 2023-08-31T00:29:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:043 2023-08-31T00:29:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:043.out 2023-08-31T00:29:27.811 INFO:teuthology.orchestra.run.smithi077.stdout:044 2023-08-31T00:29:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:044.out 2023-08-31T00:29:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:045 2023-08-31T00:29:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:045.out 2023-08-31T00:29:27.812 INFO:teuthology.orchestra.run.smithi077.stdout:046 2023-08-31T00:29:27.813 INFO:teuthology.orchestra.run.smithi077.stdout:046.out 2023-08-31T00:29:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:047 2023-08-31T00:29:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:047.out 2023-08-31T00:29:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:048 2023-08-31T00:29:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:048.out 2023-08-31T00:29:27.814 INFO:teuthology.orchestra.run.smithi077.stdout:049 2023-08-31T00:29:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:049.out 2023-08-31T00:29:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:050 2023-08-31T00:29:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:050.cfg 2023-08-31T00:29:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.default 2023-08-31T00:29:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.nojournal 2023-08-31T00:29:27.815 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.xfsquota 2023-08-31T00:29:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:051 2023-08-31T00:29:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:051.out 2023-08-31T00:29:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:052 2023-08-31T00:29:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:052.out 2023-08-31T00:29:27.816 INFO:teuthology.orchestra.run.smithi077.stdout:053 2023-08-31T00:29:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:053.out 2023-08-31T00:29:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:054 2023-08-31T00:29:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:054.out 2023-08-31T00:29:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:055 2023-08-31T00:29:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:055.out 2023-08-31T00:29:27.817 INFO:teuthology.orchestra.run.smithi077.stdout:056 2023-08-31T00:29:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:056.out 2023-08-31T00:29:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:057 2023-08-31T00:29:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:057.out 2023-08-31T00:29:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:058 2023-08-31T00:29:27.818 INFO:teuthology.orchestra.run.smithi077.stdout:058.out 2023-08-31T00:29:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:059 2023-08-31T00:29:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:059.out 2023-08-31T00:29:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:060 2023-08-31T00:29:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:060.out 2023-08-31T00:29:27.819 INFO:teuthology.orchestra.run.smithi077.stdout:061 2023-08-31T00:29:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:061.out 2023-08-31T00:29:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:062 2023-08-31T00:29:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:062.out 2023-08-31T00:29:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:063 2023-08-31T00:29:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:063.out 2023-08-31T00:29:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:064 2023-08-31T00:29:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:064.out 2023-08-31T00:29:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:065 2023-08-31T00:29:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:065.out 2023-08-31T00:29:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:066 2023-08-31T00:29:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:066.out 2023-08-31T00:29:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:067 2023-08-31T00:29:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:067.out 2023-08-31T00:29:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:068 2023-08-31T00:29:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:068.out 2023-08-31T00:29:27.822 INFO:teuthology.orchestra.run.smithi077.stdout:069 2023-08-31T00:29:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:069.out 2023-08-31T00:29:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:070 2023-08-31T00:29:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:070.out 2023-08-31T00:29:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:071 2023-08-31T00:29:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:071.out 2023-08-31T00:29:27.823 INFO:teuthology.orchestra.run.smithi077.stdout:072 2023-08-31T00:29:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:072.out 2023-08-31T00:29:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:073 2023-08-31T00:29:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:073.out 2023-08-31T00:29:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:074 2023-08-31T00:29:27.824 INFO:teuthology.orchestra.run.smithi077.stdout:074.out 2023-08-31T00:29:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:075 2023-08-31T00:29:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:075.out 2023-08-31T00:29:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:076 2023-08-31T00:29:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:076.out 2023-08-31T00:29:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:077 2023-08-31T00:29:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:077.out 2023-08-31T00:29:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:078 2023-08-31T00:29:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:078.out 2023-08-31T00:29:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:079 2023-08-31T00:29:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:079.out 2023-08-31T00:29:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:080 2023-08-31T00:29:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:080.out 2023-08-31T00:29:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:081 2023-08-31T00:29:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:081.out 2023-08-31T00:29:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:082 2023-08-31T00:29:27.827 INFO:teuthology.orchestra.run.smithi077.stdout:082.out 2023-08-31T00:29:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:083 2023-08-31T00:29:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:083.out 2023-08-31T00:29:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:084 2023-08-31T00:29:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:084.out 2023-08-31T00:29:27.828 INFO:teuthology.orchestra.run.smithi077.stdout:085 2023-08-31T00:29:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:085.out 2023-08-31T00:29:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:086 2023-08-31T00:29:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:086.out 2023-08-31T00:29:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:087 2023-08-31T00:29:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:087.out 2023-08-31T00:29:27.829 INFO:teuthology.orchestra.run.smithi077.stdout:088 2023-08-31T00:29:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:088.out 2023-08-31T00:29:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:089 2023-08-31T00:29:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:089.out 2023-08-31T00:29:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:090 2023-08-31T00:29:27.830 INFO:teuthology.orchestra.run.smithi077.stdout:090.out 2023-08-31T00:29:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:091 2023-08-31T00:29:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:091.out 2023-08-31T00:29:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:092 2023-08-31T00:29:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:092.out 2023-08-31T00:29:27.831 INFO:teuthology.orchestra.run.smithi077.stdout:093 2023-08-31T00:29:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:093.out 2023-08-31T00:29:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:094 2023-08-31T00:29:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:094.out 2023-08-31T00:29:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:095 2023-08-31T00:29:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:095.out 2023-08-31T00:29:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:096 2023-08-31T00:29:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:096.out 2023-08-31T00:29:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:097 2023-08-31T00:29:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:097.out 2023-08-31T00:29:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:098 2023-08-31T00:29:27.833 INFO:teuthology.orchestra.run.smithi077.stdout:098.out 2023-08-31T00:29:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:099 2023-08-31T00:29:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:099.out 2023-08-31T00:29:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:100 2023-08-31T00:29:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:100.out 2023-08-31T00:29:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:101 2023-08-31T00:29:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:101.out 2023-08-31T00:29:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:102 2023-08-31T00:29:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:102.out 2023-08-31T00:29:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:103 2023-08-31T00:29:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:103.out 2023-08-31T00:29:27.835 INFO:teuthology.orchestra.run.smithi077.stdout:104 2023-08-31T00:29:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:104.out 2023-08-31T00:29:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:105 2023-08-31T00:29:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:105.out 2023-08-31T00:29:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:106 2023-08-31T00:29:27.836 INFO:teuthology.orchestra.run.smithi077.stdout:106.out 2023-08-31T00:29:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:107 2023-08-31T00:29:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:107.out 2023-08-31T00:29:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:108 2023-08-31T00:29:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:108.out 2023-08-31T00:29:27.837 INFO:teuthology.orchestra.run.smithi077.stdout:109 2023-08-31T00:29:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:109.out 2023-08-31T00:29:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:110 2023-08-31T00:29:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:110.out 2023-08-31T00:29:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:111 2023-08-31T00:29:27.838 INFO:teuthology.orchestra.run.smithi077.stdout:111.out 2023-08-31T00:29:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:112 2023-08-31T00:29:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:112.out 2023-08-31T00:29:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:113 2023-08-31T00:29:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:113.out 2023-08-31T00:29:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:114 2023-08-31T00:29:27.839 INFO:teuthology.orchestra.run.smithi077.stdout:114.out 2023-08-31T00:29:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:115 2023-08-31T00:29:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:115.out 2023-08-31T00:29:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:116 2023-08-31T00:29:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:116.out 2023-08-31T00:29:27.840 INFO:teuthology.orchestra.run.smithi077.stdout:117 2023-08-31T00:29:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:117.out 2023-08-31T00:29:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:118 2023-08-31T00:29:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:118.out 2023-08-31T00:29:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:119 2023-08-31T00:29:27.841 INFO:teuthology.orchestra.run.smithi077.stdout:119.out 2023-08-31T00:29:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:120 2023-08-31T00:29:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:120.out 2023-08-31T00:29:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:121 2023-08-31T00:29:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:121.out 2023-08-31T00:29:27.842 INFO:teuthology.orchestra.run.smithi077.stdout:122 2023-08-31T00:29:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:122.out 2023-08-31T00:29:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:123 2023-08-31T00:29:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:123.out 2023-08-31T00:29:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:124 2023-08-31T00:29:27.843 INFO:teuthology.orchestra.run.smithi077.stdout:124.out 2023-08-31T00:29:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:125 2023-08-31T00:29:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:125.out 2023-08-31T00:29:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:126 2023-08-31T00:29:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:126.out 2023-08-31T00:29:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:127 2023-08-31T00:29:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:127.out 2023-08-31T00:29:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:128 2023-08-31T00:29:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:128.out 2023-08-31T00:29:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:129 2023-08-31T00:29:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:129.out 2023-08-31T00:29:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:130 2023-08-31T00:29:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:130.out 2023-08-31T00:29:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:131 2023-08-31T00:29:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:131.out 2023-08-31T00:29:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:132 2023-08-31T00:29:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:132.out 2023-08-31T00:29:27.846 INFO:teuthology.orchestra.run.smithi077.stdout:133 2023-08-31T00:29:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:133.out 2023-08-31T00:29:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:134 2023-08-31T00:29:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:134.out 2023-08-31T00:29:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:135 2023-08-31T00:29:27.847 INFO:teuthology.orchestra.run.smithi077.stdout:135.out 2023-08-31T00:29:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:136 2023-08-31T00:29:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:136.out 2023-08-31T00:29:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:137 2023-08-31T00:29:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:137.out 2023-08-31T00:29:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:138 2023-08-31T00:29:27.848 INFO:teuthology.orchestra.run.smithi077.stdout:138.out 2023-08-31T00:29:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:139 2023-08-31T00:29:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:139.out 2023-08-31T00:29:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:140 2023-08-31T00:29:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:140.out 2023-08-31T00:29:27.849 INFO:teuthology.orchestra.run.smithi077.stdout:141 2023-08-31T00:29:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:141.out 2023-08-31T00:29:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:142 2023-08-31T00:29:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:142.out 2023-08-31T00:29:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:143 2023-08-31T00:29:27.850 INFO:teuthology.orchestra.run.smithi077.stdout:143.out 2023-08-31T00:29:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:144 2023-08-31T00:29:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:144.out 2023-08-31T00:29:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:145 2023-08-31T00:29:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:145.out 2023-08-31T00:29:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:146 2023-08-31T00:29:27.851 INFO:teuthology.orchestra.run.smithi077.stdout:146.out 2023-08-31T00:29:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:147 2023-08-31T00:29:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:147.out 2023-08-31T00:29:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:148 2023-08-31T00:29:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:148.out 2023-08-31T00:29:27.852 INFO:teuthology.orchestra.run.smithi077.stdout:149 2023-08-31T00:29:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:149.out 2023-08-31T00:29:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:150 2023-08-31T00:29:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:150.out 2023-08-31T00:29:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:151 2023-08-31T00:29:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:151.out 2023-08-31T00:29:27.853 INFO:teuthology.orchestra.run.smithi077.stdout:152 2023-08-31T00:29:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:152.out 2023-08-31T00:29:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:153 2023-08-31T00:29:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:153.out 2023-08-31T00:29:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:154 2023-08-31T00:29:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:154.out 2023-08-31T00:29:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:155 2023-08-31T00:29:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:155.out 2023-08-31T00:29:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:156 2023-08-31T00:29:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:156.out 2023-08-31T00:29:27.855 INFO:teuthology.orchestra.run.smithi077.stdout:157 2023-08-31T00:29:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:157.out 2023-08-31T00:29:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:158 2023-08-31T00:29:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:158.out 2023-08-31T00:29:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:159 2023-08-31T00:29:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:159.out 2023-08-31T00:29:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:160 2023-08-31T00:29:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:160.out 2023-08-31T00:29:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:161 2023-08-31T00:29:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:161.out 2023-08-31T00:29:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:162 2023-08-31T00:29:27.857 INFO:teuthology.orchestra.run.smithi077.stdout:162.out 2023-08-31T00:29:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:163 2023-08-31T00:29:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:163.out 2023-08-31T00:29:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:164 2023-08-31T00:29:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:164.out 2023-08-31T00:29:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:165 2023-08-31T00:29:27.858 INFO:teuthology.orchestra.run.smithi077.stdout:165.out 2023-08-31T00:29:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:166 2023-08-31T00:29:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:166.out 2023-08-31T00:29:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:167 2023-08-31T00:29:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:167.out 2023-08-31T00:29:27.859 INFO:teuthology.orchestra.run.smithi077.stdout:168 2023-08-31T00:29:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:168.out 2023-08-31T00:29:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:169 2023-08-31T00:29:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:169.out 2023-08-31T00:29:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:170 2023-08-31T00:29:27.860 INFO:teuthology.orchestra.run.smithi077.stdout:170.out 2023-08-31T00:29:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:171 2023-08-31T00:29:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:171.out 2023-08-31T00:29:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:172 2023-08-31T00:29:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:172.out 2023-08-31T00:29:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:173 2023-08-31T00:29:27.861 INFO:teuthology.orchestra.run.smithi077.stdout:173.out 2023-08-31T00:29:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:174 2023-08-31T00:29:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:174.out 2023-08-31T00:29:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:175 2023-08-31T00:29:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:175.out 2023-08-31T00:29:27.862 INFO:teuthology.orchestra.run.smithi077.stdout:176 2023-08-31T00:29:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:176.out 2023-08-31T00:29:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:177 2023-08-31T00:29:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:177.out 2023-08-31T00:29:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:178 2023-08-31T00:29:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:178.out 2023-08-31T00:29:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:179 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:179.out 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:180 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:180.out 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:181 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:181.out 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:182 2023-08-31T00:29:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:182.out 2023-08-31T00:29:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:183 2023-08-31T00:29:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:183.out 2023-08-31T00:29:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:184 2023-08-31T00:29:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:184.out 2023-08-31T00:29:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:185 2023-08-31T00:29:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:185.out 2023-08-31T00:29:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:186 2023-08-31T00:29:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:186.out 2023-08-31T00:29:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:187 2023-08-31T00:29:27.866 INFO:teuthology.orchestra.run.smithi077.stdout:187.out 2023-08-31T00:29:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:188 2023-08-31T00:29:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:188.out 2023-08-31T00:29:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:189 2023-08-31T00:29:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:189.out 2023-08-31T00:29:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:190 2023-08-31T00:29:27.867 INFO:teuthology.orchestra.run.smithi077.stdout:190.out 2023-08-31T00:29:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:191 2023-08-31T00:29:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:191.out 2023-08-31T00:29:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:192 2023-08-31T00:29:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:192.out 2023-08-31T00:29:27.868 INFO:teuthology.orchestra.run.smithi077.stdout:193 2023-08-31T00:29:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:193.out 2023-08-31T00:29:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:194 2023-08-31T00:29:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:194.out 2023-08-31T00:29:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:195 2023-08-31T00:29:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:195.out 2023-08-31T00:29:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:196 2023-08-31T00:29:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:196.out 2023-08-31T00:29:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:197 2023-08-31T00:29:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:197.out 2023-08-31T00:29:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:198 2023-08-31T00:29:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:198.out 2023-08-31T00:29:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:199 2023-08-31T00:29:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:199.out 2023-08-31T00:29:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:200 2023-08-31T00:29:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:200.out 2023-08-31T00:29:27.871 INFO:teuthology.orchestra.run.smithi077.stdout:201 2023-08-31T00:29:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:201.out 2023-08-31T00:29:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:202 2023-08-31T00:29:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:202.out 2023-08-31T00:29:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:203 2023-08-31T00:29:27.872 INFO:teuthology.orchestra.run.smithi077.stdout:203.out 2023-08-31T00:29:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:204 2023-08-31T00:29:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:204.out 2023-08-31T00:29:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:205 2023-08-31T00:29:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:205.out 2023-08-31T00:29:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:206 2023-08-31T00:29:27.873 INFO:teuthology.orchestra.run.smithi077.stdout:206.out 2023-08-31T00:29:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:207 2023-08-31T00:29:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:207.out 2023-08-31T00:29:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:208 2023-08-31T00:29:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:208.out 2023-08-31T00:29:27.874 INFO:teuthology.orchestra.run.smithi077.stdout:209 2023-08-31T00:29:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:209.out 2023-08-31T00:29:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:210 2023-08-31T00:29:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:210.out 2023-08-31T00:29:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:211 2023-08-31T00:29:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:211.out 2023-08-31T00:29:27.875 INFO:teuthology.orchestra.run.smithi077.stdout:212 2023-08-31T00:29:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:212.out 2023-08-31T00:29:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:213 2023-08-31T00:29:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:213.out 2023-08-31T00:29:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:214 2023-08-31T00:29:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:214.out 2023-08-31T00:29:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:215 2023-08-31T00:29:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:215.out 2023-08-31T00:29:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:216 2023-08-31T00:29:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:216.out 2023-08-31T00:29:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:217 2023-08-31T00:29:27.877 INFO:teuthology.orchestra.run.smithi077.stdout:217.out 2023-08-31T00:29:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:218 2023-08-31T00:29:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:218.out 2023-08-31T00:29:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:219 2023-08-31T00:29:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:219.out 2023-08-31T00:29:27.878 INFO:teuthology.orchestra.run.smithi077.stdout:220 2023-08-31T00:29:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:220.out 2023-08-31T00:29:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:221 2023-08-31T00:29:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:221.out 2023-08-31T00:29:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:222 2023-08-31T00:29:27.879 INFO:teuthology.orchestra.run.smithi077.stdout:222.out 2023-08-31T00:29:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:223 2023-08-31T00:29:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:223.out 2023-08-31T00:29:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:224 2023-08-31T00:29:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:224.out 2023-08-31T00:29:27.880 INFO:teuthology.orchestra.run.smithi077.stdout:225 2023-08-31T00:29:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:225.out 2023-08-31T00:29:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:226 2023-08-31T00:29:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:226.out 2023-08-31T00:29:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:227 2023-08-31T00:29:27.881 INFO:teuthology.orchestra.run.smithi077.stdout:227.out 2023-08-31T00:29:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:228 2023-08-31T00:29:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:228.out 2023-08-31T00:29:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:229 2023-08-31T00:29:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:229.out 2023-08-31T00:29:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:230 2023-08-31T00:29:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:230.out 2023-08-31T00:29:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:231 2023-08-31T00:29:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:231.out 2023-08-31T00:29:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:232 2023-08-31T00:29:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:232.out 2023-08-31T00:29:27.883 INFO:teuthology.orchestra.run.smithi077.stdout:233 2023-08-31T00:29:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:233.out 2023-08-31T00:29:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:234 2023-08-31T00:29:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:234.out 2023-08-31T00:29:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:235 2023-08-31T00:29:27.884 INFO:teuthology.orchestra.run.smithi077.stdout:235.out 2023-08-31T00:29:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:236 2023-08-31T00:29:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:236.out 2023-08-31T00:29:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:237 2023-08-31T00:29:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:237.out 2023-08-31T00:29:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:238 2023-08-31T00:29:27.885 INFO:teuthology.orchestra.run.smithi077.stdout:238.out 2023-08-31T00:29:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:239 2023-08-31T00:29:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:239.out 2023-08-31T00:29:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:240 2023-08-31T00:29:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:240.out 2023-08-31T00:29:27.886 INFO:teuthology.orchestra.run.smithi077.stdout:241 2023-08-31T00:29:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:241.out 2023-08-31T00:29:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:242 2023-08-31T00:29:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:242.out 2023-08-31T00:29:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:243 2023-08-31T00:29:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:243.out 2023-08-31T00:29:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:244 2023-08-31T00:29:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:244.out 2023-08-31T00:29:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:245 2023-08-31T00:29:27.888 INFO:teuthology.orchestra.run.smithi077.stdout:245.out 2023-08-31T00:29:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:246 2023-08-31T00:29:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:246.out 2023-08-31T00:29:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:247 2023-08-31T00:29:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:247.out 2023-08-31T00:29:27.889 INFO:teuthology.orchestra.run.smithi077.stdout:248 2023-08-31T00:29:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:248.out 2023-08-31T00:29:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:249 2023-08-31T00:29:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:249.out 2023-08-31T00:29:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:250 2023-08-31T00:29:27.890 INFO:teuthology.orchestra.run.smithi077.stdout:250.out 2023-08-31T00:29:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:251 2023-08-31T00:29:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:251.out 2023-08-31T00:29:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:252 2023-08-31T00:29:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:252.out 2023-08-31T00:29:27.891 INFO:teuthology.orchestra.run.smithi077.stdout:253 2023-08-31T00:29:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:253.out 2023-08-31T00:29:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:254 2023-08-31T00:29:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:254.out 2023-08-31T00:29:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:255 2023-08-31T00:29:27.892 INFO:teuthology.orchestra.run.smithi077.stdout:255.out 2023-08-31T00:29:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:256 2023-08-31T00:29:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:256.out 2023-08-31T00:29:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:257 2023-08-31T00:29:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:257.out 2023-08-31T00:29:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:258 2023-08-31T00:29:27.893 INFO:teuthology.orchestra.run.smithi077.stdout:258.out 2023-08-31T00:29:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:259 2023-08-31T00:29:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:259.out 2023-08-31T00:29:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:260 2023-08-31T00:29:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:260.out 2023-08-31T00:29:27.894 INFO:teuthology.orchestra.run.smithi077.stdout:261 2023-08-31T00:29:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:261.out 2023-08-31T00:29:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:262 2023-08-31T00:29:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:262.out 2023-08-31T00:29:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:263 2023-08-31T00:29:27.895 INFO:teuthology.orchestra.run.smithi077.stdout:263.out 2023-08-31T00:29:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:264 2023-08-31T00:29:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:264.out 2023-08-31T00:29:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:265 2023-08-31T00:29:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:265.out 2023-08-31T00:29:27.896 INFO:teuthology.orchestra.run.smithi077.stdout:266 2023-08-31T00:29:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:266.out 2023-08-31T00:29:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:267 2023-08-31T00:29:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:267.out 2023-08-31T00:29:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:268 2023-08-31T00:29:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:268.out 2023-08-31T00:29:27.897 INFO:teuthology.orchestra.run.smithi077.stdout:269 2023-08-31T00:29:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:269.out 2023-08-31T00:29:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:270 2023-08-31T00:29:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:270.out 2023-08-31T00:29:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:271 2023-08-31T00:29:27.898 INFO:teuthology.orchestra.run.smithi077.stdout:271.out 2023-08-31T00:29:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:272 2023-08-31T00:29:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:272.out 2023-08-31T00:29:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:273 2023-08-31T00:29:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:273.out 2023-08-31T00:29:27.899 INFO:teuthology.orchestra.run.smithi077.stdout:274 2023-08-31T00:29:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:274.out 2023-08-31T00:29:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:275 2023-08-31T00:29:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:275.out 2023-08-31T00:29:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:276 2023-08-31T00:29:27.900 INFO:teuthology.orchestra.run.smithi077.stdout:276.out 2023-08-31T00:29:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:277 2023-08-31T00:29:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:277.out 2023-08-31T00:29:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:278 2023-08-31T00:29:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:278.out 2023-08-31T00:29:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:279 2023-08-31T00:29:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:279.out 2023-08-31T00:29:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:280 2023-08-31T00:29:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:280.out 2023-08-31T00:29:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:281 2023-08-31T00:29:27.902 INFO:teuthology.orchestra.run.smithi077.stdout:281.out 2023-08-31T00:29:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:282 2023-08-31T00:29:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:282.out 2023-08-31T00:29:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:283 2023-08-31T00:29:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:283.out 2023-08-31T00:29:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:284 2023-08-31T00:29:27.903 INFO:teuthology.orchestra.run.smithi077.stdout:284.out 2023-08-31T00:29:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:285 2023-08-31T00:29:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:285.out 2023-08-31T00:29:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:286 2023-08-31T00:29:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:286.out 2023-08-31T00:29:27.904 INFO:teuthology.orchestra.run.smithi077.stdout:287 2023-08-31T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:287.out 2023-08-31T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:288 2023-08-31T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:288.out 2023-08-31T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:289 2023-08-31T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:289.out 2023-08-31T00:29:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:290 2023-08-31T00:29:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:290.out 2023-08-31T00:29:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:291 2023-08-31T00:29:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:291.out 2023-08-31T00:29:27.906 INFO:teuthology.orchestra.run.smithi077.stdout:292 2023-08-31T00:29:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:292.out 2023-08-31T00:29:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:293 2023-08-31T00:29:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:293.out 2023-08-31T00:29:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:294 2023-08-31T00:29:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:294.out 2023-08-31T00:29:27.907 INFO:teuthology.orchestra.run.smithi077.stdout:295 2023-08-31T00:29:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:295.out 2023-08-31T00:29:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:296 2023-08-31T00:29:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:296.out 2023-08-31T00:29:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:297 2023-08-31T00:29:27.908 INFO:teuthology.orchestra.run.smithi077.stdout:297.out 2023-08-31T00:29:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:298 2023-08-31T00:29:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:298.out 2023-08-31T00:29:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:299 2023-08-31T00:29:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:299.out 2023-08-31T00:29:27.909 INFO:teuthology.orchestra.run.smithi077.stdout:300 2023-08-31T00:29:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:300.out 2023-08-31T00:29:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:301 2023-08-31T00:29:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:301.out 2023-08-31T00:29:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:302 2023-08-31T00:29:27.910 INFO:teuthology.orchestra.run.smithi077.stdout:302.out 2023-08-31T00:29:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:303 2023-08-31T00:29:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:303.out 2023-08-31T00:29:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:304 2023-08-31T00:29:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:304.out 2023-08-31T00:29:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:305 2023-08-31T00:29:27.911 INFO:teuthology.orchestra.run.smithi077.stdout:305.out 2023-08-31T00:29:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:306 2023-08-31T00:29:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:306.out 2023-08-31T00:29:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:307 2023-08-31T00:29:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:307.out 2023-08-31T00:29:27.912 INFO:teuthology.orchestra.run.smithi077.stdout:308 2023-08-31T00:29:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:308.out 2023-08-31T00:29:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:309 2023-08-31T00:29:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:309.out 2023-08-31T00:29:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:310 2023-08-31T00:29:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:310.out 2023-08-31T00:29:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:311 2023-08-31T00:29:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:311.out 2023-08-31T00:29:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:312 2023-08-31T00:29:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:312.out 2023-08-31T00:29:27.914 INFO:teuthology.orchestra.run.smithi077.stdout:313 2023-08-31T00:29:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:313.out 2023-08-31T00:29:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:314 2023-08-31T00:29:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:314.out 2023-08-31T00:29:27.915 INFO:teuthology.orchestra.run.smithi077.stdout:315 2023-08-31T00:29:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:315.out 2023-08-31T00:29:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:316 2023-08-31T00:29:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:316.out 2023-08-31T00:29:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:317 2023-08-31T00:29:27.917 INFO:teuthology.orchestra.run.smithi077.stdout:317.out 2023-08-31T00:29:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:318 2023-08-31T00:29:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:318.out 2023-08-31T00:29:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:319 2023-08-31T00:29:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:319.out 2023-08-31T00:29:27.918 INFO:teuthology.orchestra.run.smithi077.stdout:320 2023-08-31T00:29:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:320.out 2023-08-31T00:29:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:321 2023-08-31T00:29:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:321.out 2023-08-31T00:29:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:322 2023-08-31T00:29:27.919 INFO:teuthology.orchestra.run.smithi077.stdout:322.out 2023-08-31T00:29:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:323 2023-08-31T00:29:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:323.out 2023-08-31T00:29:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:324 2023-08-31T00:29:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:324.out 2023-08-31T00:29:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:325 2023-08-31T00:29:27.920 INFO:teuthology.orchestra.run.smithi077.stdout:325.out 2023-08-31T00:29:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:326 2023-08-31T00:29:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:326.out 2023-08-31T00:29:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:327 2023-08-31T00:29:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:327.out 2023-08-31T00:29:27.921 INFO:teuthology.orchestra.run.smithi077.stdout:328 2023-08-31T00:29:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:328.out 2023-08-31T00:29:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:329 2023-08-31T00:29:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:329.out 2023-08-31T00:29:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:330 2023-08-31T00:29:27.922 INFO:teuthology.orchestra.run.smithi077.stdout:330.out 2023-08-31T00:29:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:331 2023-08-31T00:29:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:331.out 2023-08-31T00:29:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:332 2023-08-31T00:29:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:332.out 2023-08-31T00:29:27.923 INFO:teuthology.orchestra.run.smithi077.stdout:333 2023-08-31T00:29:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:333.out 2023-08-31T00:29:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:334 2023-08-31T00:29:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:334.out 2023-08-31T00:29:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:335 2023-08-31T00:29:27.924 INFO:teuthology.orchestra.run.smithi077.stdout:335.out 2023-08-31T00:29:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:336 2023-08-31T00:29:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:336.out 2023-08-31T00:29:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:337 2023-08-31T00:29:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:337.out 2023-08-31T00:29:27.925 INFO:teuthology.orchestra.run.smithi077.stdout:338 2023-08-31T00:29:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:338.out 2023-08-31T00:29:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:339 2023-08-31T00:29:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:339.out 2023-08-31T00:29:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:340 2023-08-31T00:29:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:340.out 2023-08-31T00:29:27.926 INFO:teuthology.orchestra.run.smithi077.stdout:341 2023-08-31T00:29:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:341.out 2023-08-31T00:29:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:342 2023-08-31T00:29:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:342.out 2023-08-31T00:29:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:343 2023-08-31T00:29:27.927 INFO:teuthology.orchestra.run.smithi077.stdout:343.out 2023-08-31T00:29:27.928 INFO:teuthology.orchestra.run.smithi077.stdout:344 2023-08-31T00:29:27.928 INFO:teuthology.orchestra.run.smithi077.stdout:344.out 2023-08-31T00:29:27.928 INFO:teuthology.orchestra.run.smithi077.stdout:345 2023-08-31T00:29:27.928 INFO:teuthology.orchestra.run.smithi077.stdout:345.out 2023-08-31T00:29:27.928 INFO:teuthology.orchestra.run.smithi077.stdout:346 2023-08-31T00:29:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:346.out 2023-08-31T00:29:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:347 2023-08-31T00:29:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:347.out 2023-08-31T00:29:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:348 2023-08-31T00:29:27.929 INFO:teuthology.orchestra.run.smithi077.stdout:348.out 2023-08-31T00:29:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:349 2023-08-31T00:29:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:349.out 2023-08-31T00:29:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:350 2023-08-31T00:29:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:350.out 2023-08-31T00:29:27.930 INFO:teuthology.orchestra.run.smithi077.stdout:351 2023-08-31T00:29:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:351.out 2023-08-31T00:29:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:352 2023-08-31T00:29:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:352.out 2023-08-31T00:29:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:353 2023-08-31T00:29:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:353.out 2023-08-31T00:29:27.931 INFO:teuthology.orchestra.run.smithi077.stdout:354 2023-08-31T00:29:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:354.out 2023-08-31T00:29:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:355 2023-08-31T00:29:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:355.out 2023-08-31T00:29:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:356 2023-08-31T00:29:27.932 INFO:teuthology.orchestra.run.smithi077.stdout:356.out 2023-08-31T00:29:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:357 2023-08-31T00:29:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:357.out 2023-08-31T00:29:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:358 2023-08-31T00:29:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:358.out 2023-08-31T00:29:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:359 2023-08-31T00:29:27.933 INFO:teuthology.orchestra.run.smithi077.stdout:359.out 2023-08-31T00:29:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:360 2023-08-31T00:29:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:360.out 2023-08-31T00:29:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:361 2023-08-31T00:29:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:361.out 2023-08-31T00:29:27.934 INFO:teuthology.orchestra.run.smithi077.stdout:362 2023-08-31T00:29:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:362.out 2023-08-31T00:29:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:363 2023-08-31T00:29:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:363.out 2023-08-31T00:29:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:364 2023-08-31T00:29:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:364.out 2023-08-31T00:29:27.935 INFO:teuthology.orchestra.run.smithi077.stdout:365 2023-08-31T00:29:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:365.out 2023-08-31T00:29:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:366 2023-08-31T00:29:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:366.out 2023-08-31T00:29:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:367 2023-08-31T00:29:27.936 INFO:teuthology.orchestra.run.smithi077.stdout:367.out 2023-08-31T00:29:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:368 2023-08-31T00:29:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:368.out 2023-08-31T00:29:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:369 2023-08-31T00:29:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:369.out 2023-08-31T00:29:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:370 2023-08-31T00:29:27.937 INFO:teuthology.orchestra.run.smithi077.stdout:370.out 2023-08-31T00:29:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:371 2023-08-31T00:29:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:371.out 2023-08-31T00:29:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:372 2023-08-31T00:29:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:372.out 2023-08-31T00:29:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:373 2023-08-31T00:29:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:373.out 2023-08-31T00:29:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:374 2023-08-31T00:29:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:374.out 2023-08-31T00:29:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:375 2023-08-31T00:29:27.939 INFO:teuthology.orchestra.run.smithi077.stdout:375.out 2023-08-31T00:29:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:376 2023-08-31T00:29:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:376.out 2023-08-31T00:29:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:377 2023-08-31T00:29:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:377.out 2023-08-31T00:29:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:378 2023-08-31T00:29:27.940 INFO:teuthology.orchestra.run.smithi077.stdout:378.out 2023-08-31T00:29:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:379 2023-08-31T00:29:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:379.out 2023-08-31T00:29:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:380 2023-08-31T00:29:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:380.out 2023-08-31T00:29:27.941 INFO:teuthology.orchestra.run.smithi077.stdout:381 2023-08-31T00:29:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:381.out 2023-08-31T00:29:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:382 2023-08-31T00:29:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:382.out 2023-08-31T00:29:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:383 2023-08-31T00:29:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:383.out 2023-08-31T00:29:27.942 INFO:teuthology.orchestra.run.smithi077.stdout:384 2023-08-31T00:29:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:384.out 2023-08-31T00:29:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:385 2023-08-31T00:29:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:385.out 2023-08-31T00:29:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:386 2023-08-31T00:29:27.943 INFO:teuthology.orchestra.run.smithi077.stdout:386.out 2023-08-31T00:29:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:387 2023-08-31T00:29:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:387.out 2023-08-31T00:29:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:388 2023-08-31T00:29:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:388.out 2023-08-31T00:29:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:389 2023-08-31T00:29:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:389.out 2023-08-31T00:29:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:390 2023-08-31T00:29:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:390.out 2023-08-31T00:29:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:391 2023-08-31T00:29:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:391.out 2023-08-31T00:29:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:392 2023-08-31T00:29:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:392.out 2023-08-31T00:29:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:393 2023-08-31T00:29:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:393.out 2023-08-31T00:29:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:394 2023-08-31T00:29:27.946 INFO:teuthology.orchestra.run.smithi077.stdout:394.out 2023-08-31T00:29:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:395 2023-08-31T00:29:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:395.out 2023-08-31T00:29:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:396 2023-08-31T00:29:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:396.out 2023-08-31T00:29:27.947 INFO:teuthology.orchestra.run.smithi077.stdout:397 2023-08-31T00:29:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:397.out 2023-08-31T00:29:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:398 2023-08-31T00:29:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:398.out 2023-08-31T00:29:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:399 2023-08-31T00:29:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:399.out 2023-08-31T00:29:27.948 INFO:teuthology.orchestra.run.smithi077.stdout:400 2023-08-31T00:29:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:400.out 2023-08-31T00:29:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:401 2023-08-31T00:29:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:401.out 2023-08-31T00:29:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:402 2023-08-31T00:29:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:402.out 2023-08-31T00:29:27.949 INFO:teuthology.orchestra.run.smithi077.stdout:403 2023-08-31T00:29:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:403.out 2023-08-31T00:29:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:404 2023-08-31T00:29:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:404.out 2023-08-31T00:29:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:405 2023-08-31T00:29:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:405.out 2023-08-31T00:29:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:406 2023-08-31T00:29:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:406.out 2023-08-31T00:29:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:407 2023-08-31T00:29:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:407.out 2023-08-31T00:29:27.951 INFO:teuthology.orchestra.run.smithi077.stdout:408 2023-08-31T00:29:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:408.out 2023-08-31T00:29:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:409 2023-08-31T00:29:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:409.out 2023-08-31T00:29:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:410 2023-08-31T00:29:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:410.out 2023-08-31T00:29:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:411 2023-08-31T00:29:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:411.out 2023-08-31T00:29:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:412 2023-08-31T00:29:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:412.out 2023-08-31T00:29:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:413 2023-08-31T00:29:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:413.out 2023-08-31T00:29:27.953 INFO:teuthology.orchestra.run.smithi077.stdout:414 2023-08-31T00:29:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:414.out 2023-08-31T00:29:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:415 2023-08-31T00:29:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:415.out 2023-08-31T00:29:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:416 2023-08-31T00:29:27.954 INFO:teuthology.orchestra.run.smithi077.stdout:416.out 2023-08-31T00:29:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:417 2023-08-31T00:29:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:417.out 2023-08-31T00:29:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:418 2023-08-31T00:29:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:418.out 2023-08-31T00:29:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:419 2023-08-31T00:29:27.955 INFO:teuthology.orchestra.run.smithi077.stdout:419.out 2023-08-31T00:29:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:420 2023-08-31T00:29:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:420.out 2023-08-31T00:29:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:421 2023-08-31T00:29:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:421.out 2023-08-31T00:29:27.956 INFO:teuthology.orchestra.run.smithi077.stdout:422 2023-08-31T00:29:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:422.out 2023-08-31T00:29:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:423 2023-08-31T00:29:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:423.out 2023-08-31T00:29:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:424 2023-08-31T00:29:27.957 INFO:teuthology.orchestra.run.smithi077.stdout:424.out 2023-08-31T00:29:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:425 2023-08-31T00:29:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:425.out 2023-08-31T00:29:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:426 2023-08-31T00:29:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:426.out 2023-08-31T00:29:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:427 2023-08-31T00:29:27.958 INFO:teuthology.orchestra.run.smithi077.stdout:427.out 2023-08-31T00:29:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:428 2023-08-31T00:29:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:428.out 2023-08-31T00:29:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:429 2023-08-31T00:29:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:429.out 2023-08-31T00:29:27.959 INFO:teuthology.orchestra.run.smithi077.stdout:430 2023-08-31T00:29:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:430.out 2023-08-31T00:29:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:431 2023-08-31T00:29:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:431.out 2023-08-31T00:29:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:432 2023-08-31T00:29:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:432.out 2023-08-31T00:29:27.960 INFO:teuthology.orchestra.run.smithi077.stdout:433 2023-08-31T00:29:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:433.out 2023-08-31T00:29:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:434 2023-08-31T00:29:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:434.out 2023-08-31T00:29:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:435 2023-08-31T00:29:27.961 INFO:teuthology.orchestra.run.smithi077.stdout:435.out 2023-08-31T00:29:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:436 2023-08-31T00:29:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:436.out 2023-08-31T00:29:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:437 2023-08-31T00:29:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:437.out 2023-08-31T00:29:27.962 INFO:teuthology.orchestra.run.smithi077.stdout:438 2023-08-31T00:29:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:438.out 2023-08-31T00:29:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:439 2023-08-31T00:29:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:439.out 2023-08-31T00:29:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:440 2023-08-31T00:29:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:440.out 2023-08-31T00:29:27.963 INFO:teuthology.orchestra.run.smithi077.stdout:441 2023-08-31T00:29:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:441.out 2023-08-31T00:29:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:442 2023-08-31T00:29:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:442.out 2023-08-31T00:29:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:443 2023-08-31T00:29:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:443.out 2023-08-31T00:29:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:444 2023-08-31T00:29:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:444.out 2023-08-31T00:29:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:445 2023-08-31T00:29:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:445.out 2023-08-31T00:29:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:446 2023-08-31T00:29:27.965 INFO:teuthology.orchestra.run.smithi077.stdout:446.out 2023-08-31T00:29:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:447 2023-08-31T00:29:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:447.out 2023-08-31T00:29:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:448 2023-08-31T00:29:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:448.out 2023-08-31T00:29:27.966 INFO:teuthology.orchestra.run.smithi077.stdout:449 2023-08-31T00:29:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:449.out 2023-08-31T00:29:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:450 2023-08-31T00:29:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:450.out 2023-08-31T00:29:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:451 2023-08-31T00:29:27.967 INFO:teuthology.orchestra.run.smithi077.stdout:451.out 2023-08-31T00:29:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:452 2023-08-31T00:29:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:452.out 2023-08-31T00:29:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:453 2023-08-31T00:29:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:453.out 2023-08-31T00:29:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:454 2023-08-31T00:29:27.968 INFO:teuthology.orchestra.run.smithi077.stdout:454.out 2023-08-31T00:29:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:455 2023-08-31T00:29:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:455.out 2023-08-31T00:29:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:456 2023-08-31T00:29:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:456.out 2023-08-31T00:29:27.969 INFO:teuthology.orchestra.run.smithi077.stdout:457 2023-08-31T00:29:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:457.out 2023-08-31T00:29:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:458 2023-08-31T00:29:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:458.out 2023-08-31T00:29:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:459 2023-08-31T00:29:27.970 INFO:teuthology.orchestra.run.smithi077.stdout:459.out 2023-08-31T00:29:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:460 2023-08-31T00:29:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:460.out 2023-08-31T00:29:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:461 2023-08-31T00:29:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:461.out 2023-08-31T00:29:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:462 2023-08-31T00:29:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:462.out 2023-08-31T00:29:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:463 2023-08-31T00:29:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:463.out 2023-08-31T00:29:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:464 2023-08-31T00:29:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:464.out 2023-08-31T00:29:27.972 INFO:teuthology.orchestra.run.smithi077.stdout:465 2023-08-31T00:29:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:465.out 2023-08-31T00:29:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:466 2023-08-31T00:29:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:466.out 2023-08-31T00:29:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:467 2023-08-31T00:29:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:467.out 2023-08-31T00:29:27.973 INFO:teuthology.orchestra.run.smithi077.stdout:468 2023-08-31T00:29:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:468.out 2023-08-31T00:29:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:469 2023-08-31T00:29:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:469.out 2023-08-31T00:29:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:470 2023-08-31T00:29:27.974 INFO:teuthology.orchestra.run.smithi077.stdout:470.out 2023-08-31T00:29:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:471 2023-08-31T00:29:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:471.out 2023-08-31T00:29:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:472 2023-08-31T00:29:27.975 INFO:teuthology.orchestra.run.smithi077.stdout:472.out 2023-08-31T00:29:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:473 2023-08-31T00:29:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:473.out 2023-08-31T00:29:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:474 2023-08-31T00:29:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:474.out 2023-08-31T00:29:27.976 INFO:teuthology.orchestra.run.smithi077.stdout:475 2023-08-31T00:29:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:475.out 2023-08-31T00:29:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:476 2023-08-31T00:29:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:476.out 2023-08-31T00:29:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:477 2023-08-31T00:29:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:477.out 2023-08-31T00:29:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:478 2023-08-31T00:29:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:478.out 2023-08-31T00:29:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:479 2023-08-31T00:29:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:479.out 2023-08-31T00:29:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:480 2023-08-31T00:29:27.978 INFO:teuthology.orchestra.run.smithi077.stdout:480.out 2023-08-31T00:29:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:481 2023-08-31T00:29:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:481.out 2023-08-31T00:29:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:482 2023-08-31T00:29:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:482.out 2023-08-31T00:29:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:483 2023-08-31T00:29:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:483.out 2023-08-31T00:29:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:484 2023-08-31T00:29:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:484.out 2023-08-31T00:29:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:485 2023-08-31T00:29:27.980 INFO:teuthology.orchestra.run.smithi077.stdout:485.out 2023-08-31T00:29:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:486 2023-08-31T00:29:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:486.out 2023-08-31T00:29:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:487 2023-08-31T00:29:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:487.out 2023-08-31T00:29:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:488 2023-08-31T00:29:27.981 INFO:teuthology.orchestra.run.smithi077.stdout:488.out 2023-08-31T00:29:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:489 2023-08-31T00:29:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:489.out 2023-08-31T00:29:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:490 2023-08-31T00:29:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:490.out 2023-08-31T00:29:27.982 INFO:teuthology.orchestra.run.smithi077.stdout:491 2023-08-31T00:29:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:491.out 2023-08-31T00:29:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:492 2023-08-31T00:29:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:492.out 2023-08-31T00:29:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:493 2023-08-31T00:29:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:493.out 2023-08-31T00:29:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:494 2023-08-31T00:29:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:494.out 2023-08-31T00:29:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:495 2023-08-31T00:29:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:495.out 2023-08-31T00:29:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:496 2023-08-31T00:29:27.984 INFO:teuthology.orchestra.run.smithi077.stdout:496.out 2023-08-31T00:29:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:497 2023-08-31T00:29:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:497.out 2023-08-31T00:29:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:498 2023-08-31T00:29:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:498.out 2023-08-31T00:29:27.985 INFO:teuthology.orchestra.run.smithi077.stdout:499 2023-08-31T00:29:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:499.out 2023-08-31T00:29:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:500 2023-08-31T00:29:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:500.out 2023-08-31T00:29:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:501 2023-08-31T00:29:27.986 INFO:teuthology.orchestra.run.smithi077.stdout:501.out 2023-08-31T00:29:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:502 2023-08-31T00:29:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:502.out 2023-08-31T00:29:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:503 2023-08-31T00:29:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:503.out 2023-08-31T00:29:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:504 2023-08-31T00:29:27.987 INFO:teuthology.orchestra.run.smithi077.stdout:504.out 2023-08-31T00:29:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:505 2023-08-31T00:29:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:505.out 2023-08-31T00:29:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:506 2023-08-31T00:29:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:506.out 2023-08-31T00:29:27.988 INFO:teuthology.orchestra.run.smithi077.stdout:507 2023-08-31T00:29:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:507.out 2023-08-31T00:29:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:508 2023-08-31T00:29:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:508.out 2023-08-31T00:29:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:509 2023-08-31T00:29:27.989 INFO:teuthology.orchestra.run.smithi077.stdout:509.out 2023-08-31T00:29:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:510 2023-08-31T00:29:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:510.out 2023-08-31T00:29:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:511 2023-08-31T00:29:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:511.out 2023-08-31T00:29:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:512 2023-08-31T00:29:27.990 INFO:teuthology.orchestra.run.smithi077.stdout:512.out 2023-08-31T00:29:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:513 2023-08-31T00:29:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:513.out 2023-08-31T00:29:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:514 2023-08-31T00:29:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:514.out 2023-08-31T00:29:27.991 INFO:teuthology.orchestra.run.smithi077.stdout:515 2023-08-31T00:29:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:515.out 2023-08-31T00:29:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:516 2023-08-31T00:29:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:516.out 2023-08-31T00:29:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:517 2023-08-31T00:29:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:517.out 2023-08-31T00:29:27.992 INFO:teuthology.orchestra.run.smithi077.stdout:518 2023-08-31T00:29:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:518.out 2023-08-31T00:29:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:519 2023-08-31T00:29:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:519.out 2023-08-31T00:29:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:520 2023-08-31T00:29:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:520.out 2023-08-31T00:29:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:521 2023-08-31T00:29:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:521.out 2023-08-31T00:29:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:522 2023-08-31T00:29:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:522.out 2023-08-31T00:29:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:523 2023-08-31T00:29:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:523.out 2023-08-31T00:29:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:524 2023-08-31T00:29:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:524.out 2023-08-31T00:29:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:525 2023-08-31T00:29:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:525.out 2023-08-31T00:29:27.995 INFO:teuthology.orchestra.run.smithi077.stdout:526 2023-08-31T00:29:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:526.out 2023-08-31T00:29:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:527 2023-08-31T00:29:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:527.out 2023-08-31T00:29:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:528 2023-08-31T00:29:27.996 INFO:teuthology.orchestra.run.smithi077.stdout:528.out 2023-08-31T00:29:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:529 2023-08-31T00:29:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:529.out 2023-08-31T00:29:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:530 2023-08-31T00:29:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:530.out 2023-08-31T00:29:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:531 2023-08-31T00:29:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:531.out 2023-08-31T00:29:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:532 2023-08-31T00:29:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:532.out 2023-08-31T00:29:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:533 2023-08-31T00:29:27.998 INFO:teuthology.orchestra.run.smithi077.stdout:533.out 2023-08-31T00:29:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:534 2023-08-31T00:29:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:534.out 2023-08-31T00:29:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:535 2023-08-31T00:29:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:535.out 2023-08-31T00:29:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:536 2023-08-31T00:29:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:536.out 2023-08-31T00:29:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:537 2023-08-31T00:29:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:537.out 2023-08-31T00:29:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:538 2023-08-31T00:29:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:538.out 2023-08-31T00:29:28.000 INFO:teuthology.orchestra.run.smithi077.stdout:539 2023-08-31T00:29:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:539.out 2023-08-31T00:29:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:540 2023-08-31T00:29:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:540.out 2023-08-31T00:29:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:541 2023-08-31T00:29:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:541.out 2023-08-31T00:29:28.001 INFO:teuthology.orchestra.run.smithi077.stdout:542 2023-08-31T00:29:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:542.out 2023-08-31T00:29:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:543 2023-08-31T00:29:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:543.out 2023-08-31T00:29:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:544 2023-08-31T00:29:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:544.out 2023-08-31T00:29:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:545 2023-08-31T00:29:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:545.out 2023-08-31T00:29:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:546 2023-08-31T00:29:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:546.out 2023-08-31T00:29:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:547 2023-08-31T00:29:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:547.out 2023-08-31T00:29:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:548 2023-08-31T00:29:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:548.out 2023-08-31T00:29:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:549 2023-08-31T00:29:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:549.out 2023-08-31T00:29:28.004 INFO:teuthology.orchestra.run.smithi077.stdout:550 2023-08-31T00:29:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:550.out 2023-08-31T00:29:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:551 2023-08-31T00:29:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:551.out 2023-08-31T00:29:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:552 2023-08-31T00:29:28.005 INFO:teuthology.orchestra.run.smithi077.stdout:552.out 2023-08-31T00:29:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:553 2023-08-31T00:29:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:553.out 2023-08-31T00:29:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:554 2023-08-31T00:29:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:554.out 2023-08-31T00:29:28.006 INFO:teuthology.orchestra.run.smithi077.stdout:555 2023-08-31T00:29:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:555.out 2023-08-31T00:29:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:556 2023-08-31T00:29:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:556.out 2023-08-31T00:29:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:557 2023-08-31T00:29:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:557.out 2023-08-31T00:29:28.007 INFO:teuthology.orchestra.run.smithi077.stdout:558 2023-08-31T00:29:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:558.out 2023-08-31T00:29:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:559 2023-08-31T00:29:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:559.out 2023-08-31T00:29:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:560 2023-08-31T00:29:28.008 INFO:teuthology.orchestra.run.smithi077.stdout:560.out 2023-08-31T00:29:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:561 2023-08-31T00:29:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:561.out 2023-08-31T00:29:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:562 2023-08-31T00:29:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:562.out 2023-08-31T00:29:28.009 INFO:teuthology.orchestra.run.smithi077.stdout:563 2023-08-31T00:29:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:563.out 2023-08-31T00:29:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:564 2023-08-31T00:29:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:564.out 2023-08-31T00:29:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:565 2023-08-31T00:29:28.010 INFO:teuthology.orchestra.run.smithi077.stdout:565.out 2023-08-31T00:29:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:566 2023-08-31T00:29:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:566.out 2023-08-31T00:29:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:567 2023-08-31T00:29:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:567.out 2023-08-31T00:29:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:568 2023-08-31T00:29:28.011 INFO:teuthology.orchestra.run.smithi077.stdout:568.out 2023-08-31T00:29:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:569 2023-08-31T00:29:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:569.out 2023-08-31T00:29:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:570 2023-08-31T00:29:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:570.out 2023-08-31T00:29:28.012 INFO:teuthology.orchestra.run.smithi077.stdout:571 2023-08-31T00:29:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:571.out 2023-08-31T00:29:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:572 2023-08-31T00:29:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:572.out 2023-08-31T00:29:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:573 2023-08-31T00:29:28.013 INFO:teuthology.orchestra.run.smithi077.stdout:573.out 2023-08-31T00:29:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:574 2023-08-31T00:29:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:574.out 2023-08-31T00:29:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:575 2023-08-31T00:29:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:575.out 2023-08-31T00:29:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:576 2023-08-31T00:29:28.014 INFO:teuthology.orchestra.run.smithi077.stdout:576.out 2023-08-31T00:29:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:577 2023-08-31T00:29:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:577.out 2023-08-31T00:29:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:578 2023-08-31T00:29:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:578.out 2023-08-31T00:29:28.015 INFO:teuthology.orchestra.run.smithi077.stdout:579 2023-08-31T00:29:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:579.out 2023-08-31T00:29:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:580 2023-08-31T00:29:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:580.out 2023-08-31T00:29:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:581 2023-08-31T00:29:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:581.out 2023-08-31T00:29:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:582 2023-08-31T00:29:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:582.out 2023-08-31T00:29:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:583 2023-08-31T00:29:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:583.out 2023-08-31T00:29:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:584 2023-08-31T00:29:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:584.out 2023-08-31T00:29:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:585 2023-08-31T00:29:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:585.out 2023-08-31T00:29:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:586 2023-08-31T00:29:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:586.out 2023-08-31T00:29:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:587 2023-08-31T00:29:28.018 INFO:teuthology.orchestra.run.smithi077.stdout:587.out 2023-08-31T00:29:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:588 2023-08-31T00:29:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:588.out 2023-08-31T00:29:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:589 2023-08-31T00:29:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:589.out 2023-08-31T00:29:28.019 INFO:teuthology.orchestra.run.smithi077.stdout:590 2023-08-31T00:29:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:590.out 2023-08-31T00:29:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:591 2023-08-31T00:29:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:591.out 2023-08-31T00:29:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:592 2023-08-31T00:29:28.020 INFO:teuthology.orchestra.run.smithi077.stdout:592.out 2023-08-31T00:29:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:593 2023-08-31T00:29:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:593.out 2023-08-31T00:29:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:594 2023-08-31T00:29:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:594.out 2023-08-31T00:29:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:595 2023-08-31T00:29:28.021 INFO:teuthology.orchestra.run.smithi077.stdout:595.out 2023-08-31T00:29:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:596 2023-08-31T00:29:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:596.out 2023-08-31T00:29:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:597 2023-08-31T00:29:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:597.out 2023-08-31T00:29:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:598 2023-08-31T00:29:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:598.out 2023-08-31T00:29:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:599 2023-08-31T00:29:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:599.out 2023-08-31T00:29:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:600 2023-08-31T00:29:28.023 INFO:teuthology.orchestra.run.smithi077.stdout:600.out 2023-08-31T00:29:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:601 2023-08-31T00:29:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:601.out 2023-08-31T00:29:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:602 2023-08-31T00:29:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:602.out 2023-08-31T00:29:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:603 2023-08-31T00:29:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:603.out 2023-08-31T00:29:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:604 2023-08-31T00:29:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:604.out 2023-08-31T00:29:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:605 2023-08-31T00:29:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:605.out 2023-08-31T00:29:28.025 INFO:teuthology.orchestra.run.smithi077.stdout:606 2023-08-31T00:29:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:606.out 2023-08-31T00:29:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:607 2023-08-31T00:29:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:607.out 2023-08-31T00:29:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:608 2023-08-31T00:29:28.026 INFO:teuthology.orchestra.run.smithi077.stdout:608.out 2023-08-31T00:29:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:609 2023-08-31T00:29:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:609.out 2023-08-31T00:29:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:610 2023-08-31T00:29:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:610.out 2023-08-31T00:29:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:611 2023-08-31T00:29:28.027 INFO:teuthology.orchestra.run.smithi077.stdout:611.out 2023-08-31T00:29:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:612 2023-08-31T00:29:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:612.out 2023-08-31T00:29:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:613 2023-08-31T00:29:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:613.out 2023-08-31T00:29:28.028 INFO:teuthology.orchestra.run.smithi077.stdout:614 2023-08-31T00:29:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:614.out 2023-08-31T00:29:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:615 2023-08-31T00:29:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:615.out 2023-08-31T00:29:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:616 2023-08-31T00:29:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:616.out 2023-08-31T00:29:28.029 INFO:teuthology.orchestra.run.smithi077.stdout:617 2023-08-31T00:29:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:617.out 2023-08-31T00:29:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:618 2023-08-31T00:29:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:618.out 2023-08-31T00:29:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:619 2023-08-31T00:29:28.030 INFO:teuthology.orchestra.run.smithi077.stdout:619.out 2023-08-31T00:29:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:620 2023-08-31T00:29:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:620.out 2023-08-31T00:29:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:621 2023-08-31T00:29:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:621.out 2023-08-31T00:29:28.031 INFO:teuthology.orchestra.run.smithi077.stdout:622 2023-08-31T00:29:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:622.out 2023-08-31T00:29:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:623 2023-08-31T00:29:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:623.out 2023-08-31T00:29:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:624 2023-08-31T00:29:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:624.out 2023-08-31T00:29:28.032 INFO:teuthology.orchestra.run.smithi077.stdout:625 2023-08-31T00:29:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:625.out 2023-08-31T00:29:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:626 2023-08-31T00:29:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:626.out 2023-08-31T00:29:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:627 2023-08-31T00:29:28.033 INFO:teuthology.orchestra.run.smithi077.stdout:627.out 2023-08-31T00:29:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:628 2023-08-31T00:29:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:628.out 2023-08-31T00:29:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:629 2023-08-31T00:29:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:629.out 2023-08-31T00:29:28.034 INFO:teuthology.orchestra.run.smithi077.stdout:630 2023-08-31T00:29:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:630.out 2023-08-31T00:29:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:631 2023-08-31T00:29:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:631.out 2023-08-31T00:29:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:632 2023-08-31T00:29:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:632.out 2023-08-31T00:29:28.035 INFO:teuthology.orchestra.run.smithi077.stdout:633 2023-08-31T00:29:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:633.out 2023-08-31T00:29:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:634 2023-08-31T00:29:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:634.out 2023-08-31T00:29:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:635 2023-08-31T00:29:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:635.out 2023-08-31T00:29:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:636 2023-08-31T00:29:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:636.out 2023-08-31T00:29:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:637 2023-08-31T00:29:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:637.out 2023-08-31T00:29:28.037 INFO:teuthology.orchestra.run.smithi077.stdout:638 2023-08-31T00:29:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:638.out 2023-08-31T00:29:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:639 2023-08-31T00:29:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:639.out 2023-08-31T00:29:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:640 2023-08-31T00:29:28.038 INFO:teuthology.orchestra.run.smithi077.stdout:640.out 2023-08-31T00:29:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:641 2023-08-31T00:29:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:641.out 2023-08-31T00:29:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:642 2023-08-31T00:29:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:642.out 2023-08-31T00:29:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:643 2023-08-31T00:29:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:643.out 2023-08-31T00:29:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:644 2023-08-31T00:29:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:644.out 2023-08-31T00:29:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:645 2023-08-31T00:29:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:645.out 2023-08-31T00:29:28.040 INFO:teuthology.orchestra.run.smithi077.stdout:646 2023-08-31T00:29:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:646.out 2023-08-31T00:29:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:647 2023-08-31T00:29:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:647.out 2023-08-31T00:29:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:648 2023-08-31T00:29:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:648.out 2023-08-31T00:29:28.041 INFO:teuthology.orchestra.run.smithi077.stdout:649 2023-08-31T00:29:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:649.out 2023-08-31T00:29:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:650 2023-08-31T00:29:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:650.out 2023-08-31T00:29:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:651 2023-08-31T00:29:28.042 INFO:teuthology.orchestra.run.smithi077.stdout:651.out 2023-08-31T00:29:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:652 2023-08-31T00:29:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:652.out 2023-08-31T00:29:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:653 2023-08-31T00:29:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:653.out 2023-08-31T00:29:28.043 INFO:teuthology.orchestra.run.smithi077.stdout:654 2023-08-31T00:29:28.044 INFO:teuthology.orchestra.run.smithi077.stdout:654.out 2023-08-31T00:29:28.044 INFO:teuthology.orchestra.run.smithi077.stdout:655 2023-08-31T00:29:28.044 INFO:teuthology.orchestra.run.smithi077.stdout:655.out 2023-08-31T00:29:28.044 INFO:teuthology.orchestra.run.smithi077.stdout:656 2023-08-31T00:29:28.044 INFO:teuthology.orchestra.run.smithi077.stdout:656.out 2023-08-31T00:29:28.044 INFO:teuthology.orchestra.run.smithi077.stdout:657 2023-08-31T00:29:28.045 INFO:teuthology.orchestra.run.smithi077.stdout:657.out 2023-08-31T00:29:28.045 INFO:teuthology.orchestra.run.smithi077.stdout:658 2023-08-31T00:29:28.045 INFO:teuthology.orchestra.run.smithi077.stdout:658.out 2023-08-31T00:29:28.045 INFO:teuthology.orchestra.run.smithi077.stdout:659 2023-08-31T00:29:28.045 INFO:teuthology.orchestra.run.smithi077.stdout:659.out 2023-08-31T00:29:28.046 INFO:teuthology.orchestra.run.smithi077.stdout:660 2023-08-31T00:29:28.046 INFO:teuthology.orchestra.run.smithi077.stdout:660.out 2023-08-31T00:29:28.046 INFO:teuthology.orchestra.run.smithi077.stdout:661 2023-08-31T00:29:28.046 INFO:teuthology.orchestra.run.smithi077.stdout:661.out 2023-08-31T00:29:28.046 INFO:teuthology.orchestra.run.smithi077.stdout:662 2023-08-31T00:29:28.047 INFO:teuthology.orchestra.run.smithi077.stdout:662.out 2023-08-31T00:29:28.047 INFO:teuthology.orchestra.run.smithi077.stdout:663 2023-08-31T00:29:28.047 INFO:teuthology.orchestra.run.smithi077.stdout:663.out 2023-08-31T00:29:28.047 INFO:teuthology.orchestra.run.smithi077.stdout:664 2023-08-31T00:29:28.047 INFO:teuthology.orchestra.run.smithi077.stdout:664.out 2023-08-31T00:29:28.048 INFO:teuthology.orchestra.run.smithi077.stdout:665 2023-08-31T00:29:28.048 INFO:teuthology.orchestra.run.smithi077.stdout:665.out 2023-08-31T00:29:28.048 INFO:teuthology.orchestra.run.smithi077.stdout:666 2023-08-31T00:29:28.048 INFO:teuthology.orchestra.run.smithi077.stdout:666.out 2023-08-31T00:29:28.048 INFO:teuthology.orchestra.run.smithi077.stdout:667 2023-08-31T00:29:28.048 INFO:teuthology.orchestra.run.smithi077.stdout:667.out 2023-08-31T00:29:28.049 INFO:teuthology.orchestra.run.smithi077.stdout:668 2023-08-31T00:29:28.049 INFO:teuthology.orchestra.run.smithi077.stdout:668.out 2023-08-31T00:29:28.049 INFO:teuthology.orchestra.run.smithi077.stdout:669 2023-08-31T00:29:28.049 INFO:teuthology.orchestra.run.smithi077.stdout:669.out 2023-08-31T00:29:28.049 INFO:teuthology.orchestra.run.smithi077.stdout:670 2023-08-31T00:29:28.050 INFO:teuthology.orchestra.run.smithi077.stdout:670.out 2023-08-31T00:29:28.050 INFO:teuthology.orchestra.run.smithi077.stdout:671 2023-08-31T00:29:28.050 INFO:teuthology.orchestra.run.smithi077.stdout:671.out 2023-08-31T00:29:28.050 INFO:teuthology.orchestra.run.smithi077.stdout:672 2023-08-31T00:29:28.050 INFO:teuthology.orchestra.run.smithi077.stdout:672.out 2023-08-31T00:29:28.051 INFO:teuthology.orchestra.run.smithi077.stdout:673 2023-08-31T00:29:28.051 INFO:teuthology.orchestra.run.smithi077.stdout:673.out 2023-08-31T00:29:28.051 INFO:teuthology.orchestra.run.smithi077.stdout:674 2023-08-31T00:29:28.051 INFO:teuthology.orchestra.run.smithi077.stdout:674.out 2023-08-31T00:29:28.051 INFO:teuthology.orchestra.run.smithi077.stdout:675 2023-08-31T00:29:28.051 INFO:teuthology.orchestra.run.smithi077.stdout:675.out 2023-08-31T00:29:28.052 INFO:teuthology.orchestra.run.smithi077.stdout:676 2023-08-31T00:29:28.052 INFO:teuthology.orchestra.run.smithi077.stdout:676.out 2023-08-31T00:29:28.052 INFO:teuthology.orchestra.run.smithi077.stdout:677 2023-08-31T00:29:28.052 INFO:teuthology.orchestra.run.smithi077.stdout:677.out 2023-08-31T00:29:28.052 INFO:teuthology.orchestra.run.smithi077.stdout:678 2023-08-31T00:29:28.053 INFO:teuthology.orchestra.run.smithi077.stdout:678.out 2023-08-31T00:29:28.053 INFO:teuthology.orchestra.run.smithi077.stdout:679 2023-08-31T00:29:28.053 INFO:teuthology.orchestra.run.smithi077.stdout:679.out 2023-08-31T00:29:28.053 INFO:teuthology.orchestra.run.smithi077.stdout:680 2023-08-31T00:29:28.053 INFO:teuthology.orchestra.run.smithi077.stdout:680.out 2023-08-31T00:29:28.053 INFO:teuthology.orchestra.run.smithi077.stdout:681 2023-08-31T00:29:28.054 INFO:teuthology.orchestra.run.smithi077.stdout:681.out 2023-08-31T00:29:28.054 INFO:teuthology.orchestra.run.smithi077.stdout:682 2023-08-31T00:29:28.054 INFO:teuthology.orchestra.run.smithi077.stdout:682.out 2023-08-31T00:29:28.054 INFO:teuthology.orchestra.run.smithi077.stdout:683 2023-08-31T00:29:28.054 INFO:teuthology.orchestra.run.smithi077.stdout:683.out 2023-08-31T00:29:28.055 INFO:teuthology.orchestra.run.smithi077.stdout:684 2023-08-31T00:29:28.055 INFO:teuthology.orchestra.run.smithi077.stdout:684.out 2023-08-31T00:29:28.055 INFO:teuthology.orchestra.run.smithi077.stdout:685 2023-08-31T00:29:28.055 INFO:teuthology.orchestra.run.smithi077.stdout:685.out 2023-08-31T00:29:28.055 INFO:teuthology.orchestra.run.smithi077.stdout:686 2023-08-31T00:29:28.055 INFO:teuthology.orchestra.run.smithi077.stdout:686.out 2023-08-31T00:29:28.056 INFO:teuthology.orchestra.run.smithi077.stdout:687 2023-08-31T00:29:28.056 INFO:teuthology.orchestra.run.smithi077.stdout:687.out 2023-08-31T00:29:28.056 INFO:teuthology.orchestra.run.smithi077.stdout:688 2023-08-31T00:29:28.056 INFO:teuthology.orchestra.run.smithi077.stdout:688.out 2023-08-31T00:29:28.056 INFO:teuthology.orchestra.run.smithi077.stdout:689 2023-08-31T00:29:28.057 INFO:teuthology.orchestra.run.smithi077.stdout:689.out 2023-08-31T00:29:28.057 INFO:teuthology.orchestra.run.smithi077.stdout:690 2023-08-31T00:29:28.057 INFO:teuthology.orchestra.run.smithi077.stdout:690.out 2023-08-31T00:29:28.057 INFO:teuthology.orchestra.run.smithi077.stdout:691 2023-08-31T00:29:28.057 INFO:teuthology.orchestra.run.smithi077.stdout:691.out 2023-08-31T00:29:28.058 INFO:teuthology.orchestra.run.smithi077.stdout:692 2023-08-31T00:29:28.058 INFO:teuthology.orchestra.run.smithi077.stdout:692.out 2023-08-31T00:29:28.058 INFO:teuthology.orchestra.run.smithi077.stdout:693 2023-08-31T00:29:28.058 INFO:teuthology.orchestra.run.smithi077.stdout:693.out 2023-08-31T00:29:28.058 INFO:teuthology.orchestra.run.smithi077.stdout:694 2023-08-31T00:29:28.059 INFO:teuthology.orchestra.run.smithi077.stdout:694.out 2023-08-31T00:29:28.059 INFO:teuthology.orchestra.run.smithi077.stdout:695 2023-08-31T00:29:28.059 INFO:teuthology.orchestra.run.smithi077.stdout:695.out 2023-08-31T00:29:28.059 INFO:teuthology.orchestra.run.smithi077.stdout:696 2023-08-31T00:29:28.059 INFO:teuthology.orchestra.run.smithi077.stdout:696.out 2023-08-31T00:29:28.059 INFO:teuthology.orchestra.run.smithi077.stdout:697 2023-08-31T00:29:28.060 INFO:teuthology.orchestra.run.smithi077.stdout:697.out 2023-08-31T00:29:28.060 INFO:teuthology.orchestra.run.smithi077.stdout:698 2023-08-31T00:29:28.060 INFO:teuthology.orchestra.run.smithi077.stdout:698.out 2023-08-31T00:29:28.060 INFO:teuthology.orchestra.run.smithi077.stdout:699 2023-08-31T00:29:28.060 INFO:teuthology.orchestra.run.smithi077.stdout:699.out 2023-08-31T00:29:28.061 INFO:teuthology.orchestra.run.smithi077.stdout:700 2023-08-31T00:29:28.061 INFO:teuthology.orchestra.run.smithi077.stdout:700.out 2023-08-31T00:29:28.061 INFO:teuthology.orchestra.run.smithi077.stdout:701 2023-08-31T00:29:28.061 INFO:teuthology.orchestra.run.smithi077.stdout:701.out 2023-08-31T00:29:28.061 INFO:teuthology.orchestra.run.smithi077.stdout:702 2023-08-31T00:29:28.062 INFO:teuthology.orchestra.run.smithi077.stdout:702.out 2023-08-31T00:29:28.062 INFO:teuthology.orchestra.run.smithi077.stdout:703 2023-08-31T00:29:28.062 INFO:teuthology.orchestra.run.smithi077.stdout:703.out 2023-08-31T00:29:28.062 INFO:teuthology.orchestra.run.smithi077.stdout:704 2023-08-31T00:29:28.062 INFO:teuthology.orchestra.run.smithi077.stdout:704.out 2023-08-31T00:29:28.063 INFO:teuthology.orchestra.run.smithi077.stdout:705 2023-08-31T00:29:28.063 INFO:teuthology.orchestra.run.smithi077.stdout:705.out 2023-08-31T00:29:28.063 INFO:teuthology.orchestra.run.smithi077.stdout:706 2023-08-31T00:29:28.063 INFO:teuthology.orchestra.run.smithi077.stdout:706.out 2023-08-31T00:29:28.063 INFO:teuthology.orchestra.run.smithi077.stdout:707 2023-08-31T00:29:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:707.out 2023-08-31T00:29:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:708 2023-08-31T00:29:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:708.out 2023-08-31T00:29:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:709 2023-08-31T00:29:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:709.out 2023-08-31T00:29:28.065 INFO:teuthology.orchestra.run.smithi077.stdout:710 2023-08-31T00:29:28.065 INFO:teuthology.orchestra.run.smithi077.stdout:710.out 2023-08-31T00:29:28.065 INFO:teuthology.orchestra.run.smithi077.stdout:711 2023-08-31T00:29:28.065 INFO:teuthology.orchestra.run.smithi077.stdout:711.out 2023-08-31T00:29:28.065 INFO:teuthology.orchestra.run.smithi077.stdout:712 2023-08-31T00:29:28.065 INFO:teuthology.orchestra.run.smithi077.stdout:712.out 2023-08-31T00:29:28.066 INFO:teuthology.orchestra.run.smithi077.stdout:713 2023-08-31T00:29:28.066 INFO:teuthology.orchestra.run.smithi077.stdout:713.out 2023-08-31T00:29:28.066 INFO:teuthology.orchestra.run.smithi077.stdout:714 2023-08-31T00:29:28.066 INFO:teuthology.orchestra.run.smithi077.stdout:714.out 2023-08-31T00:29:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:715 2023-08-31T00:29:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:715.out 2023-08-31T00:29:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:716 2023-08-31T00:29:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:716.out 2023-08-31T00:29:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:717 2023-08-31T00:29:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:717.out 2023-08-31T00:29:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:718 2023-08-31T00:29:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:718.out 2023-08-31T00:29:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:719 2023-08-31T00:29:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:719.out 2023-08-31T00:29:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:720 2023-08-31T00:29:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:720.out 2023-08-31T00:29:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:721 2023-08-31T00:29:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:721.out 2023-08-31T00:29:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:722 2023-08-31T00:29:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:722.out 2023-08-31T00:29:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:723 2023-08-31T00:29:28.070 INFO:teuthology.orchestra.run.smithi077.stdout:723.out 2023-08-31T00:29:28.070 INFO:teuthology.orchestra.run.smithi077.stdout:724 2023-08-31T00:29:28.070 INFO:teuthology.orchestra.run.smithi077.stdout:724.out 2023-08-31T00:29:28.070 INFO:teuthology.orchestra.run.smithi077.stdout:725 2023-08-31T00:29:28.070 INFO:teuthology.orchestra.run.smithi077.stdout:725.out 2023-08-31T00:29:28.071 INFO:teuthology.orchestra.run.smithi077.stdout:726 2023-08-31T00:29:28.071 INFO:teuthology.orchestra.run.smithi077.stdout:726.out 2023-08-31T00:29:28.071 INFO:teuthology.orchestra.run.smithi077.stdout:727 2023-08-31T00:29:28.071 INFO:teuthology.orchestra.run.smithi077.stdout:727.out 2023-08-31T00:29:28.071 INFO:teuthology.orchestra.run.smithi077.stdout:728 2023-08-31T00:29:28.071 INFO:teuthology.orchestra.run.smithi077.stdout:728.out 2023-08-31T00:29:28.072 INFO:teuthology.orchestra.run.smithi077.stdout:729 2023-08-31T00:29:28.072 INFO:teuthology.orchestra.run.smithi077.stdout:729.out 2023-08-31T00:29:28.072 INFO:teuthology.orchestra.run.smithi077.stdout:730 2023-08-31T00:29:28.072 INFO:teuthology.orchestra.run.smithi077.stdout:730.out 2023-08-31T00:29:28.072 INFO:teuthology.orchestra.run.smithi077.stdout:731 2023-08-31T00:29:28.073 INFO:teuthology.orchestra.run.smithi077.stdout:731.out 2023-08-31T00:29:28.073 INFO:teuthology.orchestra.run.smithi077.stdout:group.list 2023-08-31T00:29:28.073 INFO:teuthology.orchestra.run.smithi077.stdout:Makefile 2023-08-31T00:29:28.074 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-08-31T00:29:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:29:28.230 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:29:28.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:30.178 INFO:teuthology.orchestra.run.smithi077.stdout:generic/001 2s 2023-08-31T00:29:30.182 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/001 2023-08-31T00:29:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:29:30.184 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:30.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[120416]: fuse finished with error 0 and tester_r 0 2023-08-31T00:29:30.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:29:30.206 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-08-31T00:29:30.373 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:29:30.377 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:29:30.377 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:30.798 INFO:teuthology.orchestra.run.smithi077.stdout:generic/002 0s 2023-08-31T00:29:30.802 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/002 2023-08-31T00:29:30.803 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:29:30.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:30.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:29:30.824 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-08-31T00:29:31.018 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:29:31.022 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:29:31.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:31.140 INFO:teuthology.orchestra.run.smithi077.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:29:31.144 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/003 2023-08-31T00:29:31.144 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/003 2023-08-31T00:29:31.144 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:29:31.146 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:31.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:29:31.213 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-08-31T00:29:31.381 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:29:31.385 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:29:31.386 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:31.518 INFO:teuthology.orchestra.run.smithi077.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-08-31T00:29:31.521 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/004 2023-08-31T00:29:31.521 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/004 2023-08-31T00:29:31.522 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:29:31.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:31.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:29:31.548 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-08-31T00:29:31.711 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:29:31.714 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:29:31.715 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:32.240 INFO:teuthology.orchestra.run.smithi077.stdout:generic/005 1s 2023-08-31T00:29:32.245 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/005 2023-08-31T00:29:32.245 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:29:32.247 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:32.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:29:32.269 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-08-31T00:29:32.474 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:29:32.478 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:29:32.478 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:29:57.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:29:57.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:30:08.200 INFO:teuthology.orchestra.run.smithi077.stdout:generic/006 36s 2023-08-31T00:30:08.266 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/006 2023-08-31T00:30:08.266 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:30:08.268 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:30:08.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:30:08.300 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-08-31T00:30:08.498 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:30:08.502 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:30:08.502 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:30:27.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:30:27.432 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:30:57.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:30:57.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:31:21.043 INFO:teuthology.orchestra.run.smithi077.stdout:generic/007 73s 2023-08-31T00:31:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/007 2023-08-31T00:31:21.104 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:31:21.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:21.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:31:21.128 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-08-31T00:31:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:31:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:31:21.477 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-31T00:31:22.347 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/008 2023-08-31T00:31:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/008 2023-08-31T00:31:22.348 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:31:22.349 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:22.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:31:22.373 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-08-31T00:31:22.536 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:31:22.540 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:31:22.540 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-08-31T00:31:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/009 2023-08-31T00:31:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/009 2023-08-31T00:31:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:31:23.396 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:23.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:31:23.417 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-08-31T00:31:23.581 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:31:23.585 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:31:23.586 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:23.706 INFO:teuthology.orchestra.run.smithi077.stdout:generic/010 [not run] /tmp/tmp.iDdVgFzsFDxfstests-dev/src/dbtest not built 2023-08-31T00:31:23.709 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/010 2023-08-31T00:31:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/010 2023-08-31T00:31:23.710 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:31:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:23.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:31:23.730 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-08-31T00:31:23.893 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:31:23.898 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:31:23.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:31:28.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:31:28.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:31:58.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:31:58.131 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:32:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:generic/011 44s 2023-08-31T00:32:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/011 2023-08-31T00:32:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:32:07.618 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:32:07.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:32:07.640 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-08-31T00:32:07.849 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:32:07.853 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:32:07.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:32:08.818 INFO:teuthology.orchestra.run.smithi077.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:32:08.822 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/012 2023-08-31T00:32:08.822 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/012 2023-08-31T00:32:08.822 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:32:08.823 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:32:08.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:32:08.856 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-08-31T00:32:09.047 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:32:09.051 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:32:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:32:28.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:32:28.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:32:59.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:32:59.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:33:29.827 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:33:29.830 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:33:52.411 INFO:teuthology.orchestra.run.smithi077.stdout:generic/013 103s 2023-08-31T00:33:52.483 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/013 2023-08-31T00:33:52.484 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:33:52.486 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:33:52.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:33:52.504 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-08-31T00:33:52.801 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:33:52.810 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:33:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:33:59.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:33:59.892 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:34:00.114 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-08-31T00:34:00.113+0000 7f2f246ed700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166448) UID: 0 2023-08-31T00:34:00.115 INFO:tasks.ceph.mds.a.smithi077.stderr:2023-08-31T00:34:00.113+0000 7f669beec700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166448) UID: 0 2023-08-31T00:37:14.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:37:14.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:37:44.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:37:44.237 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:38:15.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:38:15.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:38:38.883 INFO:teuthology.orchestra.run.smithi077.stdout:generic/014 286s 2023-08-31T00:38:38.890 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/014 2023-08-31T00:38:38.891 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:38.895 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:38.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:38.922 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-08-31T00:38:39.238 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:39.251 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:39.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:39.453 INFO:teuthology.orchestra.run.smithi077.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:38:39.457 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/015 2023-08-31T00:38:39.458 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/015 2023-08-31T00:38:39.458 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:39.462 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:39.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:39.485 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-08-31T00:38:39.765 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:39.770 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:39.770 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:41.506 INFO:teuthology.orchestra.run.smithi077.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:38:41.510 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/016 2023-08-31T00:38:41.510 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/016 2023-08-31T00:38:41.510 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:41.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:41.546 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-08-31T00:38:42.155 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:42.162 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:42.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:42.398 INFO:teuthology.orchestra.run.smithi077.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:38:42.402 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/017 2023-08-31T00:38:42.402 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/017 2023-08-31T00:38:42.402 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:42.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:42.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:42.434 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-08-31T00:38:42.728 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:42.732 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:42.732 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:42.919 INFO:teuthology.orchestra.run.smithi077.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:38:42.924 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/018 2023-08-31T00:38:42.924 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/018 2023-08-31T00:38:42.924 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:42.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:42.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:42.956 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-08-31T00:38:43.283 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:43.288 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:43.485 INFO:teuthology.orchestra.run.smithi077.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:38:43.495 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/019 2023-08-31T00:38:43.495 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/019 2023-08-31T00:38:43.495 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:43.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:43.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:43.519 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-08-31T00:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:43.818 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:43.818 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:45.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:38:45.270 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:38:56.413 INFO:teuthology.orchestra.run.smithi077.stdout:generic/020 - output mismatch (see /tmp/tmp.iDdVgFzsFDxfstests-dev/results//generic/020.out.bad) 2023-08-31T00:38:56.418 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/020.out 2023-08-31 00:28:15.241192860 +0000 2023-08-31T00:38:56.418 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.iDdVgFzsFDxfstests-dev/results//generic/020.out.bad 2023-08-31 00:38:56.405705623 +0000 2023-08-31T00:38:56.419 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -47,9 +47,13 @@ 2023-08-31T00:38:56.419 INFO:teuthology.orchestra.run.smithi077.stdout: user.snrub="fish2\012" 2023-08-31T00:38:56.419 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:56.419 INFO:teuthology.orchestra.run.smithi077.stdout: *** really long value 2023-08-31T00:38:56.419 INFO:teuthology.orchestra.run.smithi077.stdout: -0000000 00 2023-08-31T00:38:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: -* 2023-08-31T00:38:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: -ATTRSIZE 2023-08-31T00:38:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_set: No space left on device 2023-08-31T00:38:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not set "long_attr" for 2023-08-31T00:38:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_get: No data available 2023-08-31T00:38:56.421 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not get "long_attr" for 2023-08-31T00:38:56.421 INFO:teuthology.orchestra.run.smithi077.stdout: +0000000 2023-08-31T00:38:56.421 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_remove: No data available 2023-08-31T00:38:56.421 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not remove "long_attr" for 2023-08-31T00:38:56.421 INFO:teuthology.orchestra.run.smithi077.stdout: *** set/get/remove really long names (expect failure) 2023-08-31T00:38:56.422 INFO:teuthology.orchestra.run.smithi077.stdout: attr_set: Invalid argument 2023-08-31T00:38:56.422 INFO:teuthology.orchestra.run.smithi077.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-08-31T00:38:56.423 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/020 2023-08-31T00:38:56.423 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/020 2023-08-31T00:38:56.423 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2023-08-31T00:38:56.423 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:56.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T00:38:56.443 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-08-31T00:38:56.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-08-31T00:38:56.444 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-08-31T00:38:57.054 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:57.058 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:57.059 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:58.859 INFO:teuthology.orchestra.run.smithi077.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:38:58.863 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/021 2023-08-31T00:38:58.863 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/021 2023-08-31T00:38:58.864 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:38:58.866 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:38:58.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:38:58.890 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-08-31T00:38:59.488 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:38:59.493 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:38:59.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:39:01.268 INFO:teuthology.orchestra.run.smithi077.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:39:01.274 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/022 2023-08-31T00:39:01.274 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/022 2023-08-31T00:39:01.274 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:39:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:39:01.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:39:01.298 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-08-31T00:39:01.916 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:39:01.931 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:39:01.931 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:39:15.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:39:15.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:39:45.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:39:45.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:40:15.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:40:15.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:40:19.689 INFO:teuthology.orchestra.run.smithi077.stdout:generic/023 78s 2023-08-31T00:40:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/023 2023-08-31T00:40:19.694 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:19.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:19.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:19.717 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-08-31T00:40:20.199 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:20.203 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:20.341 INFO:teuthology.orchestra.run.smithi077.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-08-31T00:40:20.344 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/024 2023-08-31T00:40:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/024 2023-08-31T00:40:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:20.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:20.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:20.375 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-08-31T00:40:20.850 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:20.854 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:20.855 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-08-31T00:40:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/025 2023-08-31T00:40:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/025 2023-08-31T00:40:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:21.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:21.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:21.037 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-08-31T00:40:21.507 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:21.511 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:21.512 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:21.675 INFO:teuthology.orchestra.run.smithi077.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-08-31T00:40:21.679 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/026 2023-08-31T00:40:21.679 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/026 2023-08-31T00:40:21.680 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:21.681 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:21.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:21.701 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-08-31T00:40:21.867 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:21.871 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:21.873 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:21.992 INFO:teuthology.orchestra.run.smithi077.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/027 2023-08-31T00:40:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/027 2023-08-31T00:40:21.996 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:21.997 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:22.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:22.021 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-08-31T00:40:22.183 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:22.188 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:22.188 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout:generic/028 5s 2023-08-31T00:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/028 2023-08-31T00:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:27.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:27.351 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-08-31T00:40:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:27.518 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:27.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:27.635 INFO:teuthology.orchestra.run.smithi077.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/029 2023-08-31T00:40:27.638 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/029 2023-08-31T00:40:27.639 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:27.640 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:27.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:27.655 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-08-31T00:40:27.821 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:27.825 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:27.825 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:27.944 INFO:teuthology.orchestra.run.smithi077.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/030 2023-08-31T00:40:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/030 2023-08-31T00:40:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:27.951 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:27.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:27.966 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-08-31T00:40:28.130 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:28.134 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:28.135 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:28.251 INFO:teuthology.orchestra.run.smithi077.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/031 2023-08-31T00:40:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/031 2023-08-31T00:40:28.255 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:28.257 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:28.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:28.281 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-08-31T00:40:28.447 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:28.452 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/032 2023-08-31T00:40:28.573 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/032 2023-08-31T00:40:28.574 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:28.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:28.595 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-08-31T00:40:28.758 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:28.763 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:28.879 INFO:teuthology.orchestra.run.smithi077.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:28.882 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/033 2023-08-31T00:40:28.882 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/033 2023-08-31T00:40:28.883 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:28.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:28.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:28.902 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-08-31T00:40:29.065 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:29.069 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/034 2023-08-31T00:40:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/034 2023-08-31T00:40:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:29.206 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:29.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:29.228 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-08-31T00:40:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:29.397 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:29.397 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:29.589 INFO:teuthology.orchestra.run.smithi077.stdout:generic/035 0s 2023-08-31T00:40:29.593 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/035 2023-08-31T00:40:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:29.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:29.614 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-08-31T00:40:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:30.090 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:30.091 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:40.318 INFO:teuthology.orchestra.run.smithi077.stdout:generic/036 10s 2023-08-31T00:40:40.322 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/036 2023-08-31T00:40:40.322 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:40.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:40.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:40.348 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-08-31T00:40:40.815 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:40.820 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:40.820 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:40.939 INFO:teuthology.orchestra.run.smithi077.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:40.943 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/037 2023-08-31T00:40:40.943 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/037 2023-08-31T00:40:40.943 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:40.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:40.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:40.962 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-08-31T00:40:41.125 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:41.129 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:41.129 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:41.249 INFO:teuthology.orchestra.run.smithi077.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/038 2023-08-31T00:40:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/038 2023-08-31T00:40:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:41.255 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:41.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:41.273 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-08-31T00:40:41.437 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:41.441 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:41.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:41.572 INFO:teuthology.orchestra.run.smithi077.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:41.575 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/039 2023-08-31T00:40:41.576 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/039 2023-08-31T00:40:41.576 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:41.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:41.601 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-08-31T00:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:41.906 INFO:teuthology.orchestra.run.smithi077.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:41.909 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/040 2023-08-31T00:40:41.909 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/040 2023-08-31T00:40:41.910 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:41.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:41.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:41.939 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-08-31T00:40:42.101 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:42.105 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:42.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:42.239 INFO:teuthology.orchestra.run.smithi077.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:42.243 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/041 2023-08-31T00:40:42.243 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/041 2023-08-31T00:40:42.244 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:42.245 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:42.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:42.271 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-08-31T00:40:42.435 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:42.439 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:42.439 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:42.560 INFO:teuthology.orchestra.run.smithi077.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:42.563 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/042 2023-08-31T00:40:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/042 2023-08-31T00:40:42.564 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:42.565 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:42.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:42.584 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-08-31T00:40:42.748 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:42.753 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:42.871 INFO:teuthology.orchestra.run.smithi077.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:42.874 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/043 2023-08-31T00:40:42.874 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/043 2023-08-31T00:40:42.875 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:42.876 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:42.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:42.895 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-08-31T00:40:43.057 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:43.061 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:43.062 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:43.180 INFO:teuthology.orchestra.run.smithi077.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:43.183 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/044 2023-08-31T00:40:43.184 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/044 2023-08-31T00:40:43.184 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:43.186 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:43.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:43.202 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-08-31T00:40:43.363 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:43.368 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:43.368 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:43.485 INFO:teuthology.orchestra.run.smithi077.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:43.489 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/045 2023-08-31T00:40:43.489 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/045 2023-08-31T00:40:43.490 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:43.491 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:43.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:43.522 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-08-31T00:40:43.689 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:43.693 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:43.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:43.811 INFO:teuthology.orchestra.run.smithi077.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:43.815 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/046 2023-08-31T00:40:43.815 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/046 2023-08-31T00:40:43.815 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:43.817 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:43.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:43.840 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-08-31T00:40:44.003 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:44.007 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:44.007 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:44.127 INFO:teuthology.orchestra.run.smithi077.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:44.130 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/047 2023-08-31T00:40:44.131 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/047 2023-08-31T00:40:44.131 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:44.131 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:44.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:44.149 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-08-31T00:40:44.312 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:44.316 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:44.316 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:44.436 INFO:teuthology.orchestra.run.smithi077.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:44.440 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/048 2023-08-31T00:40:44.440 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/048 2023-08-31T00:40:44.440 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:44.442 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:44.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:44.464 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-08-31T00:40:44.626 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:44.630 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:44.630 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:44.750 INFO:teuthology.orchestra.run.smithi077.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/049 2023-08-31T00:40:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/049 2023-08-31T00:40:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:44.755 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:44.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:44.775 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-08-31T00:40:44.939 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:44.943 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:44.943 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:45.068 INFO:teuthology.orchestra.run.smithi077.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:45.071 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/050 2023-08-31T00:40:45.071 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/050 2023-08-31T00:40:45.071 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:45.073 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:45.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:45.106 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-08-31T00:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:45.396 INFO:teuthology.orchestra.run.smithi077.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:45.399 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/051 2023-08-31T00:40:45.399 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/051 2023-08-31T00:40:45.400 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:45.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:45.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:45.425 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-08-31T00:40:45.588 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:45.592 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:45.592 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:45.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:40:45.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:40:45.715 INFO:teuthology.orchestra.run.smithi077.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:45.719 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/052 2023-08-31T00:40:45.719 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/052 2023-08-31T00:40:45.720 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:45.721 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:45.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:45.744 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-08-31T00:40:45.946 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:45.950 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:45.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:46.067 INFO:teuthology.orchestra.run.smithi077.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:46.071 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/053 2023-08-31T00:40:46.071 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/053 2023-08-31T00:40:46.071 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:46.073 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:46.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:46.091 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-08-31T00:40:46.252 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:46.256 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:46.256 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:46.375 INFO:teuthology.orchestra.run.smithi077.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:46.379 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/054 2023-08-31T00:40:46.379 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/054 2023-08-31T00:40:46.380 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:46.381 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:46.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:46.403 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-08-31T00:40:46.568 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:46.572 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:46.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:46.696 INFO:teuthology.orchestra.run.smithi077.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:46.699 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/055 2023-08-31T00:40:46.700 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/055 2023-08-31T00:40:46.700 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:46.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:46.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:46.723 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-08-31T00:40:46.886 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:46.890 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:46.890 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:47.023 INFO:teuthology.orchestra.run.smithi077.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:47.026 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/056 2023-08-31T00:40:47.027 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/056 2023-08-31T00:40:47.027 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:47.028 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:47.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:47.054 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-08-31T00:40:47.216 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:47.220 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:47.220 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:47.350 INFO:teuthology.orchestra.run.smithi077.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:47.353 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/057 2023-08-31T00:40:47.354 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/057 2023-08-31T00:40:47.354 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:47.355 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:47.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:47.378 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-08-31T00:40:47.544 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:47.547 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:47.548 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:48.431 INFO:teuthology.orchestra.run.smithi077.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:40:48.434 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/058 2023-08-31T00:40:48.438 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/058 2023-08-31T00:40:48.438 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:48.439 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:48.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:48.457 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-08-31T00:40:48.940 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:48.944 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:48.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:49.078 INFO:teuthology.orchestra.run.smithi077.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:49.081 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/059 2023-08-31T00:40:49.082 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/059 2023-08-31T00:40:49.082 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:49.084 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:49.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:49.106 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-08-31T00:40:49.269 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:49.273 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:49.273 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:50.166 INFO:teuthology.orchestra.run.smithi077.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:40:50.169 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/060 2023-08-31T00:40:50.170 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/060 2023-08-31T00:40:50.170 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:50.171 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:50.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:50.202 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-08-31T00:40:50.707 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:50.712 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:50.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:51.612 INFO:teuthology.orchestra.run.smithi077.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:40:51.615 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/061 2023-08-31T00:40:51.616 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/061 2023-08-31T00:40:51.616 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:51.617 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:51.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:51.638 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-08-31T00:40:52.108 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:52.112 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:52.234 INFO:teuthology.orchestra.run.smithi077.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:52.237 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/062 2023-08-31T00:40:52.237 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/062 2023-08-31T00:40:52.237 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:52.239 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:52.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:52.253 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-08-31T00:40:52.416 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:52.420 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:52.421 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:53.313 INFO:teuthology.orchestra.run.smithi077.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-08-31T00:40:53.317 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/063 2023-08-31T00:40:53.317 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/063 2023-08-31T00:40:53.317 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:53.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:53.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:53.342 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-08-31T00:40:53.815 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:53.820 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:53.936 INFO:teuthology.orchestra.run.smithi077.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:53.940 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/064 2023-08-31T00:40:53.940 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/064 2023-08-31T00:40:53.940 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:53.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:53.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:53.965 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-08-31T00:40:54.128 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:54.132 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:54.132 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:54.263 INFO:teuthology.orchestra.run.smithi077.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:54.267 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/065 2023-08-31T00:40:54.267 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/065 2023-08-31T00:40:54.267 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:54.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:54.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:54.290 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-08-31T00:40:54.455 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:54.459 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:54.460 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:54.593 INFO:teuthology.orchestra.run.smithi077.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:54.597 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/066 2023-08-31T00:40:54.597 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/066 2023-08-31T00:40:54.597 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:54.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:54.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:54.618 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-08-31T00:40:54.783 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:54.787 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:54.788 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:54.936 INFO:teuthology.orchestra.run.smithi077.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:54.940 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/067 2023-08-31T00:40:54.940 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/067 2023-08-31T00:40:54.940 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:54.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:54.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:54.962 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-08-31T00:40:55.126 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:55.130 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:55.131 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:55.266 INFO:teuthology.orchestra.run.smithi077.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:55.270 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/068 2023-08-31T00:40:55.270 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/068 2023-08-31T00:40:55.271 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:55.272 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:55.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:55.299 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-08-31T00:40:55.463 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:55.467 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:55.467 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:55.587 INFO:teuthology.orchestra.run.smithi077.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:40:55.590 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/069 2023-08-31T00:40:55.591 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/069 2023-08-31T00:40:55.591 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:40:55.592 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:40:55.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:40:55.611 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-08-31T00:40:55.774 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:40:55.779 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:40:55.779 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:15.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:41:15.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:41:45.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:41:45.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:41:54.678 INFO:teuthology.orchestra.run.smithi077.stdout:generic/070 59s 2023-08-31T00:41:54.682 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/070 2023-08-31T00:41:54.683 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:41:54.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:54.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:41:54.705 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-08-31T00:41:55.190 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:41:55.194 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:41:55.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:55.313 INFO:teuthology.orchestra.run.smithi077.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:41:55.316 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/071 2023-08-31T00:41:55.316 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/071 2023-08-31T00:41:55.317 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:41:55.318 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:55.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:41:55.337 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-08-31T00:41:55.502 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:41:55.506 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:41:55.506 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:57.128 INFO:teuthology.orchestra.run.smithi077.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-08-31T00:41:57.131 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/072 2023-08-31T00:41:57.133 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/072 2023-08-31T00:41:57.133 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:41:57.134 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:57.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:41:57.154 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-08-31T00:41:57.433 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:41:57.438 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:41:57.438 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:57.637 INFO:teuthology.orchestra.run.smithi077.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T00:41:57.641 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/073 2023-08-31T00:41:57.641 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/073 2023-08-31T00:41:57.641 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T00:41:57.644 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:41:57.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T00:41:57.663 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-08-31T00:41:57.941 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T00:41:57.950 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T00:41:57.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T00:42:15.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:42:15.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:42:46.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:42:46.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:43:16.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:43:16.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:43:46.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:43:46.358 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:44:16.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:44:16.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:44:46.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:44:46.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:45:17.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:45:17.358 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:45:47.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:45:47.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:46:18.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:46:18.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:46:48.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:46:48.498 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:47:18.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:47:18.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:47:29.764 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T00:47:29.763+0000 7fb1c50d9700 -1 bdev(0x557c8462c000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2023-08-31T00:47:29.765 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T00:47:29.764+0000 7fb1c10d1700 -1 bdev(0x557c8462c000 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2023-08-31T00:47:48.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:47:48.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:48:19.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:48:19.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:48:49.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:48:49.150 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:49:19.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:49:19.271 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:49:49.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:49:49.541 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:50:19.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:50:19.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:50:50.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:50:50.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:51:20.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:51:20.359 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:51:50.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:51:50.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:52:20.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:52:20.943 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:52:51.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:52:51.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:53:21.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:53:21.469 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:53:51.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:53:51.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:54:22.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:54:22.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:54:52.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:54:52.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:55:22.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:55:22.458 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:55:50.154 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T00:55:50.153+0000 7f631efef700 -1 bdev(0x55595b33c000 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2023-08-31T00:55:50.155 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T00:55:50.153+0000 7f631dfed700 -1 bdev(0x55595b33c000 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2023-08-31T00:55:53.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:55:53.269 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:56:23.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:56:23.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:56:54.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:56:54.454 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:57:24.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:57:24.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:57:54.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:57:54.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:58:25.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:58:25.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:58:55.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:58:55.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:59:25.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:59:25.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:59:55.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T00:59:55.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:00:26.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:00:26.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:00:56.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:00:56.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:01:26.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:01:26.285 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:01:56.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:01:56.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:02:26.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:02:26.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:02:57.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:02:57.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:03:27.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:03:27.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:03:57.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:03:57.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:03:57.604 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T01:03:57.602+0000 7f73b1e01700 -1 Fail to open '/proc/114028/cmdline' error = (2) No such file or directory 2023-08-31T01:03:57.604 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T01:03:57.602+0000 7f73b1e01700 -1 received signal: Hangup from (PID: 114028) UID: 0 2023-08-31T01:03:57.605 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T01:03:57.604+0000 7fa9c77bb700 -1 Fail to open '/proc/114028/cmdline' error = (2) No such file or directory 2023-08-31T01:03:57.605 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T01:03:57.604+0000 7fa9c77bb700 -1 received signal: Hangup from (PID: 114028) UID: 0 2023-08-31T01:03:57.606 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T01:03:57.604+0000 7fb6dcf28700 -1 Fail to open '/proc/114028/cmdline' error = (2) No such file or directory 2023-08-31T01:03:57.606 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T01:03:57.604+0000 7fb6dcf28700 -1 received signal: Hangup from (PID: 114028) UID: 0 2023-08-31T01:03:57.606 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T01:03:57.604+0000 7f2da7343700 -1 Fail to open '/proc/114028/cmdline' error = (2) No such file or directory 2023-08-31T01:03:57.607 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T01:03:57.604+0000 7f2da7343700 -1 received signal: Hangup from (PID: 114028) UID: 0 2023-08-31T01:06:41.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:06:41.819 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:07:12.005 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:07:12.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:07:42.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:07:42.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:08:12.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:08:12.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:08:42.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:08:42.374 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:09:12.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:09:12.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:09:20.846 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T01:09:20.842+0000 7f2d9670c700 -1 bdev(0x55e644ac2000 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2023-08-31T01:09:42.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:09:42.878 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:09:42.912 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T01:09:42.911+0000 7fa9c77bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114235) UID: 0 2023-08-31T01:09:42.912 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T01:09:42.911+0000 7f2da7343700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114235) UID: 0 2023-08-31T01:09:42.913 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T01:09:42.911+0000 7f73b1e01700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114235) UID: 0 2023-08-31T01:09:42.913 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T01:09:42.911+0000 7fb6dcf28700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114235) UID: 0 2023-08-31T01:10:55.017 INFO:teuthology.orchestra.run.smithi077.stdout:generic/074 1737s 2023-08-31T01:10:55.027 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/074 2023-08-31T01:10:55.027 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:10:55.029 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:10:55.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:10:55.048 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-08-31T01:10:55.754 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:10:55.758 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:10:55.758 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:34.858 INFO:teuthology.orchestra.run.smithi077.stdout:generic/075 39s 2023-08-31T01:11:34.862 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/075 2023-08-31T01:11:34.862 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:34.864 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:34.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:34.912 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-08-31T01:11:35.384 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:35.388 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:35.507 INFO:teuthology.orchestra.run.smithi077.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:35.510 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/076 2023-08-31T01:11:35.511 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/076 2023-08-31T01:11:35.511 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:35.512 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:35.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:35.535 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-08-31T01:11:35.701 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:35.705 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:35.705 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:38.618 INFO:teuthology.orchestra.run.smithi077.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:38.622 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/077 2023-08-31T01:11:38.622 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/077 2023-08-31T01:11:38.623 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:38.624 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:38.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:38.651 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-08-31T01:11:38.820 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:38.823 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:38.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:38.977 INFO:teuthology.orchestra.run.smithi077.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-08-31T01:11:38.980 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/078 2023-08-31T01:11:38.981 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/078 2023-08-31T01:11:38.981 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:38.982 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:39.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:39.005 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-08-31T01:11:39.518 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:39.522 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:39.522 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:39.690 INFO:teuthology.orchestra.run.smithi077.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-08-31T01:11:39.693 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/079 2023-08-31T01:11:39.693 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/079 2023-08-31T01:11:39.694 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:39.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:39.712 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-08-31T01:11:39.876 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:39.880 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:39.881 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:42.079 INFO:teuthology.orchestra.run.smithi077.stdout:generic/080 3s 2023-08-31T01:11:42.106 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/080 2023-08-31T01:11:42.106 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:42.108 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:42.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:42.129 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-08-31T01:11:42.315 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:42.319 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:42.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:42.449 INFO:teuthology.orchestra.run.smithi077.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:42.452 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/081 2023-08-31T01:11:42.453 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/081 2023-08-31T01:11:42.453 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:42.454 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:42.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:42.477 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-08-31T01:11:42.642 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:42.648 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:42.648 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:42.773 INFO:teuthology.orchestra.run.smithi077.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:42.776 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/082 2023-08-31T01:11:42.776 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/082 2023-08-31T01:11:42.777 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:42.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:42.793 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-08-31T01:11:42.957 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:42.961 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:42.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:43.083 INFO:teuthology.orchestra.run.smithi077.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:43.086 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/083 2023-08-31T01:11:43.087 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/083 2023-08-31T01:11:43.087 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:43.088 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:43.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:43.119 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-08-31T01:11:43.284 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:43.288 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:43.405 INFO:teuthology.orchestra.run.smithi077.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:43.408 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/084 2023-08-31T01:11:43.409 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/084 2023-08-31T01:11:43.409 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:43.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:43.436 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-08-31T01:11:43.599 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:43.604 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:43.604 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:43.762 INFO:teuthology.orchestra.run.smithi077.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-08-31T01:11:43.766 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/085 2023-08-31T01:11:43.767 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/085 2023-08-31T01:11:43.767 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:43.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:43.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-08-31T01:11:43.950 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:43.955 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:49.413 INFO:teuthology.orchestra.run.smithi077.stdout:generic/086 6s 2023-08-31T01:11:49.467 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/086 2023-08-31T01:11:49.468 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:49.470 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:49.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:49.557 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-08-31T01:11:50.860 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:50.865 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:50.865 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:51.218 INFO:teuthology.orchestra.run.smithi077.stdout:generic/087 1s 2023-08-31T01:11:51.222 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/087 2023-08-31T01:11:51.222 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:51.224 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:51.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:51.244 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-08-31T01:11:51.750 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:51.754 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:51.938 INFO:teuthology.orchestra.run.smithi077.stdout:generic/088 0s 2023-08-31T01:11:51.943 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/088 2023-08-31T01:11:51.943 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-08-31T01:11:51.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:11:51.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-08-31T01:11:51.959 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.iDdVgFzsFDxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-08-31T01:11:52.476 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-08-31T01:11:52.480 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-08-31T01:11:52.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-08-31T01:12:05.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:12:05.339 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:12:05.389 INFO:tasks.ceph.osd.4.smithi139.stderr:2023-08-31T01:12:05.388+0000 7fa9c77bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114294) UID: 0 2023-08-31T01:12:05.390 INFO:tasks.ceph.osd.5.smithi139.stderr:2023-08-31T01:12:05.388+0000 7f2da7343700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114294) UID: 0 2023-08-31T01:12:05.390 INFO:tasks.ceph.osd.6.smithi139.stderr:2023-08-31T01:12:05.388+0000 7fb6dcf28700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114294) UID: 0 2023-08-31T01:12:05.391 INFO:tasks.ceph.osd.7.smithi139.stderr:2023-08-31T01:12:05.388+0000 7f73b1e01700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114294) UID: 0 2023-08-31T01:14:14.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:14:14.262 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:14:44.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:14:44.424 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:15:14.574 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:15:14.578 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:15:44.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:15:44.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:16:14.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:16:14.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:16:44.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:16:44.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:17:15.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:17:15.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:17:45.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:17:45.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:18:15.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:18:15.266 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:18:45.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:18:45.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:19:15.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:19:15.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:19:45.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:19:45.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:20:15.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:20:15.837 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:20:45.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:20:45.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:21:16.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:21:16.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:21:46.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:21:46.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:22:16.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:22:16.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:22:46.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:22:46.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:23:16.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:23:16.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:23:46.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:23:46.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:24:16.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:24:16.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:24:47.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:24:47.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:25:17.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:25:17.178 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:25:47.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:25:47.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:26:17.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:26:17.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:26:47.548 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:26:47.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:27:17.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:27:17.733 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:27:47.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:27:47.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:28:18.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:28:18.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:28:48.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:28:48.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:29:18.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:29:18.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:29:48.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:29:48.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:30:18.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:30:18.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:30:48.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:30:48.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:31:18.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:31:18.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:31:48.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:31:48.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:32:19.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:32:19.055 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:32:49.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:32:49.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:33:19.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:33:19.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:33:49.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:33:49.632 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:34:19.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:34:19.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:34:49.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:34:49.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:35:20.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:35:20.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:35:50.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:35:50.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:36:20.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:36:20.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:36:50.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:36:50.448 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:37:20.588 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:37:20.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:37:50.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:37:50.732 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:38:20.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:38:20.906 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:38:51.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:38:51.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:39:21.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:39:21.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:39:51.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:39:51.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:40:21.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:40:21.461 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:40:51.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:40:51.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:41:21.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:41:21.736 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:41:51.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:41:51.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:42:21.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:42:21.998 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:42:52.163 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:42:52.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:43:22.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:43:22.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:43:52.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:43:52.486 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:44:22.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:44:22.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:44:52.699 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:44:52.703 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:45:22.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:45:22.835 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:45:52.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:45:52.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:46:23.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:46:23.160 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:46:53.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:46:53.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:47:23.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:47:23.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:47:53.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:47:53.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:48:23.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:48:23.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:48:53.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:48:53.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:49:23.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:49:23.870 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:49:54.037 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:49:54.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:50:24.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:50:24.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:50:54.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:50:54.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:51:24.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:51:24.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:51:54.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:51:54.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:52:24.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:52:24.655 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:52:54.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:52:54.829 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:53:24.965 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:53:24.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:53:55.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:53:55.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:54:25.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:54:25.262 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:54:55.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:54:55.547 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:55:25.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:55:25.619 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:55:55.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:55:55.759 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:56:25.905 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:56:25.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:56:56.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:56:56.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:57:26.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:57:26.183 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:57:56.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:57:56.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:26.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:26.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:56.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:58:56.455 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:26.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:26.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:56.677 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T01:59:56.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:26.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:26.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:56.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:00:56.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:27.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:27.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:57.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:01:57.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:27.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:27.562 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:57.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:02:57.805 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:03:27.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:03:27.870 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:03:57.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:03:58.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:04:28.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:04:28.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:04:58.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:04:58.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:05:28.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:05:28.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:05:58.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:05:58.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:06:28.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:06:28.758 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:06:58.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:06:58.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:07:29.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:07:29.047 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:07:59.182 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:07:59.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:08:29.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:08:29.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:08:59.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:08:59.507 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:09:29.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:09:29.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:09:59.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:09:59.781 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:10:29.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:10:29.842 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:10:59.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:10:59.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:11:30.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:11:30.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:12:00.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:12:00.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:12:30.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:12:30.300 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:13:00.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:13:00.383 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:13:30.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:13:30.446 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:14:00.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:14:00.569 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:14:30.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:14:30.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:15:00.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:15:00.801 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:15:30.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:15:30.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:16:01.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:16:01.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:16:31.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:16:31.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:17:01.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:17:01.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:17:31.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:17:31.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:18:01.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:18:01.505 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:18:31.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:18:31.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:19:01.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:19:01.751 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:19:31.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:19:31.890 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:20:02.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:20:02.023 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:20:32.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:20:32.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:21:02.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:21:02.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:21:32.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:21:32.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:22:02.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:22:02.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:22:32.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:22:32.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:23:02.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:23:02.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:23:32.924 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:23:32.927 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:24:03.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:24:03.084 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:24:33.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:24:33.224 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:25:03.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:25:03.405 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:25:33.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:25:33.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:26:03.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:26:03.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:26:33.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:26:33.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:27:03.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:27:03.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:27:34.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:27:34.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:28:04.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:28:04.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:28:34.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:28:34.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:29:04.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:29:04.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:29:34.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:29:34.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:30:04.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:30:04.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:30:34.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:30:34.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:31:05.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:31:05.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:31:35.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:31:35.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:32:05.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:32:05.327 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:32:35.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:32:35.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:33:05.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:33:05.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:33:35.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:33:35.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:34:05.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:34:05.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:34:35.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:34:35.876 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:35:06.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:35:06.035 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:35:36.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:35:36.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:36:06.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:36:06.246 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:36:36.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:36:36.308 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:37:06.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:37:06.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:37:36.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:37:36.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:38:06.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:38:06.655 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:38:36.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:38:36.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:39:06.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:39:06.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:39:37.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:39:37.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:40:07.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:40:07.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:40:37.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:40:37.313 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:41:07.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:41:07.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:41:37.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:41:37.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:42:07.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:42:07.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:42:37.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:42:37.893 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:43:08.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:43:08.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:43:38.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:43:38.170 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:44:08.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:44:08.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:44:38.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:44:38.437 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:45:08.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:45:08.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:45:38.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:45:38.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:46:08.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:46:08.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:46:38.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:46:38.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:47:09.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:47:09.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:47:39.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:47:39.209 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:48:09.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:48:09.349 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:48:39.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:48:39.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:49:09.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:49:09.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:49:39.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:49:39.671 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:50:09.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:50:09.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:50:39.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:50:39.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:51:09.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:51:09.976 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:51:40.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:51:40.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:52:10.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:52:10.204 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:52:40.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:52:40.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:53:10.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:53:10.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:53:40.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:53:40.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:54:10.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:54:10.628 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:54:40.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:54:40.740 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:55:10.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:55:10.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:55:40.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:55:40.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:56:11.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:56:11.085 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:56:41.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:56:41.200 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:57:11.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:57:11.290 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:57:41.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:57:41.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:58:11.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:58:11.595 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:58:41.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:58:41.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:59:11.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:59:11.899 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:59:42.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T02:59:42.040 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:00:12.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:00:12.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:00:42.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:00:42.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:01:12.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:01:12.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:01:42.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:01:42.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:02:12.552 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:02:12.556 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:02:42.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:02:42.687 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:03:12.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:03:12.752 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:03:42.886 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:03:42.890 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:04:13.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:04:13.044 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:04:43.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:04:43.175 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:05:13.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:05:13.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:05:43.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:05:43.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:06:13.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:06:13.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:06:43.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:06:43.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:07:13.868 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:07:13.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:07:44.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:07:44.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:08:14.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:08:14.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:08:44.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:08:44.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:09:14.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:09:14.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:09:44.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:09:44.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:10:14.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:10:14.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:10:44.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:10:44.776 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:11:14.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:11:14.912 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:11:45.058 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:11:45.061 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:12:15.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:12:15.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:12:45.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:12:45.290 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:13:15.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:13:15.614 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:13:45.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:13:45.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:14:15.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:14:15.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:14:45.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:14:45.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:15:16.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:15:16.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:15:46.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:15:46.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:16:16.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:16:16.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:16:46.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:16:46.533 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:17:16.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:17:16.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:17:46.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:17:46.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:18:16.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:18:16.797 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:18:46.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:18:46.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:19:17.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:19:17.098 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:19:47.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:19:47.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:20:17.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:20:17.399 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:20:47.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:20:47.555 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:21:17.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:21:17.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:21:47.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:21:47.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:22:17.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:22:17.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:22:48.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:22:48.084 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:23:18.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:23:18.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:23:48.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:23:48.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:24:18.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:24:18.443 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:24:48.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:24:48.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:25:18.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:25:18.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:25:48.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:25:48.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:26:19.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:26:19.062 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:26:49.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:26:49.201 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:27:19.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:27:19.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:27:49.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:27:49.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:28:19.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:28:19.663 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:28:49.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:28:49.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:29:19.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:29:19.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:29:50.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:29:50.070 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:30:20.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:30:20.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:30:50.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:30:50.381 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:31:20.438 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:31:20.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:31:50.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:31:50.586 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:32:20.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:32:20.685 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:32:50.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:32:50.814 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:33:20.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:33:20.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:33:51.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:33:51.150 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:34:21.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:34:21.263 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:34:51.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:34:51.350 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:35:21.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:35:21.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:35:51.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:35:51.605 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:36:21.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:36:21.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:36:51.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:36:51.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:37:21.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:37:21.926 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:37:52.050 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:37:52.054 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:38:22.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:38:22.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:38:52.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:38:52.405 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:39:22.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:39:22.519 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:39:52.606 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:39:52.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:40:22.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:40:22.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:40:52.886 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:40:52.890 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:41:23.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:41:23.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:41:53.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:41:53.075 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:42:23.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:42:23.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:42:53.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:42:53.391 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:43:23.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:43:23.455 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:43:53.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:43:53.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:44:23.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:44:23.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:44:53.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:44:53.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:45:23.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:45:23.873 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:45:54.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:45:54.004 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:46:24.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:46:24.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:46:54.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:46:54.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:47:24.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:47:24.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:47:54.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:47:54.437 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:48:24.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:48:24.560 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:48:54.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:48:54.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:49:24.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:49:24.858 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:49:54.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:49:54.921 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:50:25.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:50:25.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:50:55.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:50:55.120 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:51:25.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:51:25.276 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:51:55.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:51:55.430 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:52:25.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:52:25.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:52:55.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:52:55.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:53:25.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:53:25.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:53:55.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:53:55.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:54:25.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:54:25.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:54:56.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:54:56.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:55:26.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:55:26.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:55:56.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:55:56.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:56:26.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:56:26.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:56:56.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:56:56.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:57:26.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:57:26.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:57:57.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:57:57.095 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:58:27.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:58:27.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:58:57.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:58:57.308 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:59:27.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:59:27.451 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:59:57.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T03:59:57.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:00:27.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:00:27.744 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:00:57.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:00:57.819 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:01:28.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:01:28.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:01:58.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:01:58.082 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:02:28.210 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:02:28.213 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:02:58.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:02:58.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:03:28.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:03:28.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:03:58.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:03:58.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:04:28.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:04:28.829 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:04:58.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:04:58.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:05:29.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:05:29.035 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:05:59.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:05:59.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:06:29.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:06:29.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:06:59.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:06:59.346 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:07:29.473 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:07:29.477 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:07:59.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:07:59.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:08:29.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:08:29.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:08:59.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:08:59.888 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:09:30.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:09:30.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:10:00.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:10:00.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:10:30.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:10:30.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:11:00.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:11:00.329 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:11:30.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:11:30.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:12:00.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:12:00.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:12:30.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:12:30.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:13:00.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:13:00.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:13:30.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:13:30.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:14:00.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:14:00.837 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:14:30.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:14:30.976 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:15:01.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:15:01.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:15:31.195 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:15:31.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:16:01.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:16:01.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:16:31.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:16:31.404 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:17:01.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:17:01.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:17:31.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:17:31.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:18:01.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:18:01.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:18:31.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:18:31.857 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:19:02.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:19:02.006 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:19:32.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:19:32.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:20:02.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:20:02.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:20:32.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:20:32.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:21:02.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:21:02.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:21:32.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:21:32.584 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:22:02.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:22:02.716 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:22:32.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:22:32.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:23:03.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:23:03.017 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:23:33.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:23:33.095 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:24:03.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:24:03.235 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:24:33.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:24:33.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:25:03.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:25:03.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:25:33.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:25:33.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:26:03.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:26:03.779 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:26:33.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:26:33.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:27:04.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:27:04.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:27:34.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:27:34.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:28:04.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:28:04.331 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:28:34.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:28:34.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:29:04.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:29:04.582 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:29:34.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:29:34.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:30:04.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:30:04.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:30:35.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:30:35.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:31:05.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:31:05.163 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:31:35.306 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:31:35.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:32:05.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:32:05.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:32:35.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:32:35.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:33:05.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:33:05.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:33:35.775 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:33:35.779 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:34:05.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:34:05.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:34:36.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:34:36.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:35:06.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:35:06.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:35:36.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:35:36.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:36:06.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:36:06.461 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:36:36.606 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:36:36.616 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:37:06.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:37:06.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:37:36.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:37:36.887 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:38:06.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:38:06.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:38:37.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:38:37.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:39:07.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:39:07.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:39:37.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:39:37.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:40:07.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:40:07.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:40:37.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:40:37.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:41:07.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:41:07.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:41:37.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:41:37.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:42:07.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:42:07.869 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:42:38.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:42:38.009 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:43:08.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:43:08.149 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:43:38.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:43:38.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:44:08.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:44:08.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:44:38.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:44:38.352 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:45:08.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:45:08.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:45:38.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:45:38.556 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:46:08.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:46:08.696 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:46:38.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:46:38.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:47:08.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:47:08.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:47:39.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:47:39.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:48:09.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:48:09.248 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:48:39.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:48:39.345 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:49:09.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:49:09.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:49:39.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:49:39.574 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:50:09.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:50:09.660 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:50:39.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:50:39.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:51:09.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:51:09.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:51:39.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:51:39.991 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:52:10.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:52:10.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:52:40.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:52:40.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:53:10.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:53:10.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:53:40.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:53:40.467 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:54:10.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:54:10.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:54:40.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:54:40.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:55:10.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:55:10.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:55:40.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:55:40.977 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:56:11.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:56:11.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:56:41.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:56:41.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:57:11.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:57:11.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:57:41.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:57:41.478 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:58:11.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:58:11.617 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:58:41.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:58:41.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:59:11.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:59:11.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:59:41.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T04:59:41.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:00:12.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:00:12.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:00:42.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:00:42.274 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:01:12.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:01:12.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:01:42.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:01:42.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:02:12.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:02:12.671 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:02:42.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:02:42.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:03:12.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:03:12.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:03:43.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:03:43.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:04:13.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:04:13.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:04:43.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:04:43.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:05:13.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:05:13.542 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:05:43.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:05:43.705 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:06:13.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:06:13.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:06:44.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:06:44.006 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:07:14.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:07:14.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:07:44.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:07:44.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:08:14.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:08:14.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:08:44.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:08:44.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:09:14.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:09:14.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:09:44.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:09:44.774 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:10:14.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:10:14.913 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:10:44.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:10:44.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:11:15.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:11:15.150 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:11:45.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:11:45.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:12:15.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:12:15.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:12:45.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:12:45.544 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:13:15.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:13:15.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:13:45.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:13:45.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:14:15.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:14:15.973 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:14:46.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:14:46.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:15:16.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:15:16.268 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:15:46.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:15:46.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:16:16.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:16:16.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:16:46.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:16:46.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:17:16.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:17:16.871 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:17:47.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:17:47.139 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:18:17.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:18:17.268 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:18:47.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:18:47.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:19:17.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:19:17.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:19:47.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:19:47.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:20:17.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:20:17.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:20:47.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:20:47.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:21:18.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:21:18.105 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:21:48.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:21:48.234 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:22:18.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:22:18.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:22:48.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:22:48.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:23:18.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:23:18.674 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:23:48.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:23:48.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:24:18.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:24:18.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:24:49.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:24:49.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:25:19.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:25:19.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:25:49.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:25:49.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:26:19.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:26:19.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:26:49.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:26:49.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:27:19.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:27:19.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:27:49.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:27:49.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:28:20.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:28:20.023 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:28:50.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:28:50.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:29:20.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:29:20.211 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:29:50.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:29:50.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:30:20.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:30:20.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:30:50.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:30:50.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:31:20.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:31:20.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:31:50.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:31:50.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:32:21.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:32:21.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:32:51.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:32:51.197 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:33:21.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:33:21.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:33:51.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:33:51.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:34:21.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:34:21.560 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:34:51.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:34:51.683 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:35:21.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:35:21.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:35:51.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:35:51.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:36:21.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:36:21.943 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:36:52.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:36:52.004 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:37:22.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:37:22.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:37:52.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:37:52.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:38:22.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:38:22.354 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:38:52.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:38:52.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:39:22.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:39:22.634 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:39:52.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:39:52.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:40:22.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:40:22.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:40:53.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:40:53.092 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:41:23.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:41:23.252 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:41:53.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:41:53.384 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:42:23.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:42:23.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:42:53.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:42:53.687 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:43:23.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:43:23.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:43:53.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:43:53.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:44:24.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:44:24.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:44:54.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:44:54.373 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:45:24.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:45:24.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:45:54.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:45:54.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:46:24.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:46:24.719 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:46:54.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:46:54.833 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:47:24.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:47:24.958 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:47:55.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:47:55.098 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:48:25.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:48:25.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:48:55.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:48:55.319 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:49:25.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:49:25.384 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:49:55.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:49:55.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:50:25.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:50:25.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:50:55.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:50:55.839 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:51:25.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:51:25.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:51:56.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:51:56.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:52:26.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:52:26.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:52:56.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:52:56.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:53:26.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:53:26.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:53:56.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:53:56.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:54:26.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:54:26.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:54:56.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:54:56.896 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:55:27.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:55:27.053 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:55:57.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:55:57.147 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:56:27.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:56:27.206 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:56:57.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:56:57.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:57:27.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:57:27.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:57:57.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:57:57.808 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:58:27.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:58:27.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:58:58.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:58:58.012 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:59:28.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:59:28.127 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:59:58.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T05:59:58.276 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:00:28.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:00:28.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:00:58.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:00:58.515 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:01:28.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:01:28.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:01:58.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:01:58.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:02:28.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:02:28.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:02:58.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:02:58.943 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:03:29.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:03:29.075 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:03:59.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:03:59.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:04:29.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:04:29.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:04:59.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:04:59.390 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:05:29.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:05:29.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:05:59.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:05:59.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:06:29.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:06:29.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:06:59.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:06:59.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:07:29.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:07:29.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:08:00.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:08:00.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:08:30.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:08:30.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:09:00.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:09:00.263 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:09:30.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:09:30.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:10:00.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:10:00.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:10:30.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:10:30.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:11:00.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:11:00.790 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:11:30.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:11:30.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:12:00.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:12:00.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:12:31.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:12:31.115 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:13:01.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:13:01.248 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:13:31.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:13:31.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:14:01.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:14:01.536 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:14:31.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:14:31.686 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:15:01.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:15:01.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:15:31.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:15:31.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:16:02.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:16:02.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:16:32.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:16:32.091 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:17:02.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:17:02.221 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:17:32.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:17:32.350 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:18:02.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:18:02.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:18:32.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:18:32.568 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:19:02.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:19:02.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:19:32.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:19:32.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:20:02.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:20:02.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:20:32.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:20:32.929 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:21:03.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:21:03.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:21:33.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:21:33.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:22:03.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:22:03.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:22:33.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:22:33.393 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:23:03.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:23:03.544 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:23:33.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:23:33.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:24:03.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:24:03.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:24:33.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:24:33.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:25:03.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:25:03.885 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:25:34.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:25:34.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:26:04.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:26:04.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:26:34.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:26:34.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:27:04.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:27:04.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:27:34.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:27:34.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:28:04.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:28:04.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:28:34.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:28:34.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:29:04.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:29:04.841 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:29:34.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:29:34.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:30:05.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:30:05.120 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:30:35.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:30:35.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:31:05.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:31:05.336 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:31:35.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:31:35.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:32:05.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:32:05.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:32:35.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:32:35.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:33:05.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:33:05.891 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:33:36.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:33:36.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:34:06.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:34:06.097 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:34:36.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:34:36.303 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:35:06.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:35:06.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:35:36.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:35:36.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:36:06.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:36:06.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:36:06.802 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-08-31T06:36:06.800+0000 7f4f9d988700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223105) UID: 0 2023-08-31T06:36:06.802 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-08-31T06:36:06.800+0000 7f633bc3e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223105) UID: 0 2023-08-31T06:36:06.803 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-08-31T06:36:06.800+0000 7fb1e1527700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223105) UID: 0 2023-08-31T06:36:06.803 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-08-31T06:36:06.800+0000 7f3e1ff23700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223105) UID: 0 2023-08-31T06:38:16.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:38:16.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:38:46.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:38:46.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:39:16.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:39:16.527 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:39:46.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:39:46.616 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:40:16.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:40:16.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:40:46.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:40:46.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:41:16.965 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:41:16.970 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:41:47.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:41:47.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:42:17.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:42:17.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:42:47.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:42:47.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:43:17.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:43:17.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:43:47.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:43:47.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:44:17.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:44:17.712 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:44:47.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:44:47.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:45:17.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:45:17.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:45:48.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:45:48.038 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:46:18.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:46:18.170 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:46:48.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:46:48.276 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:47:18.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:47:18.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:47:48.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:47:48.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:48:18.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:48:18.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:48:48.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:48:48.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:49:18.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:49:18.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:49:48.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:49:48.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:50:19.045 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:50:19.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:50:49.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:50:49.114 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:51:19.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:51:19.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:51:49.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:51:49.352 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:52:19.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:52:19.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:52:49.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:52:49.490 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:53:19.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:53:19.564 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:53:49.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:53:49.713 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:54:19.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:54:19.774 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:54:49.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:54:49.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:55:20.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:55:20.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:55:50.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:55:50.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:56:20.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:56:20.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:56:50.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:56:50.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:57:20.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:57:20.401 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:57:50.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:57:50.551 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:58:20.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:58:21.105 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:58:51.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:58:51.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:59:21.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:59:21.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:59:51.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T06:59:51.411 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:00:21.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:00:21.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:00:51.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:00:51.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:01:21.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:01:21.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:01:51.944 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:01:51.947 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:02:22.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:02:22.012 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:02:52.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:02:52.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:03:22.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:03:22.209 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:03:52.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:03:52.290 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:04:22.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:04:22.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:04:52.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:04:52.555 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:05:22.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:05:22.643 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:05:52.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:05:52.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:06:22.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:06:22.942 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:06:53.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:06:53.073 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:07:23.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:07:23.222 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:07:53.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:07:53.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:08:23.498 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:08:23.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:08:53.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:08:53.649 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:09:23.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:09:23.795 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:09:53.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:09:53.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:10:24.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:10:24.063 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:10:54.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:10:54.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:11:24.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:11:24.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:11:54.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:11:54.463 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:12:24.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:12:24.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:12:54.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:12:54.737 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:13:24.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:13:24.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:13:55.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:13:55.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:14:25.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:14:25.158 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:14:55.289 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:14:55.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:15:25.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:15:25.436 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:15:55.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:15:55.573 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:16:25.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:16:25.762 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:16:56.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:16:56.076 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:17:26.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:17:26.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:17:56.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:17:56.247 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:18:26.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:18:26.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:18:56.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:18:56.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:19:26.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:19:26.641 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:19:56.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:19:56.814 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:20:26.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:20:26.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:20:57.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:20:57.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:21:27.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:21:27.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:21:57.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:21:57.325 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:22:27.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:22:27.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:22:57.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:22:57.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:23:27.714 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:23:27.718 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:23:57.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:23:57.865 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:24:27.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:24:27.988 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:24:58.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:24:58.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:25:28.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:25:28.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:25:58.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:25:58.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:26:28.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:26:28.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:26:58.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:26:58.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:27:28.739 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:27:28.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:27:58.872 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:27:58.876 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:28:29.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:28:29.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:28:59.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:28:59.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:29:29.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:29:29.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:29:59.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:29:59.416 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:30:29.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:30:29.554 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:30:59.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:30:59.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:31:29.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:31:29.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:31:59.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:31:59.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:32:30.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:32:30.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:33:00.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:33:00.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:33:30.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:33:30.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:34:00.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:34:00.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:34:30.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:34:30.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:35:00.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:35:00.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:35:30.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:35:30.836 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:36:01.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:36:01.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:36:31.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:36:31.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:37:01.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:37:01.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:37:31.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:37:31.344 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:38:01.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:38:01.461 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:38:31.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:38:31.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:39:01.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:39:01.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:39:31.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:39:31.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:40:01.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:40:01.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:40:31.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:40:31.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:41:02.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:41:02.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:41:32.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:41:32.224 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:42:02.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:42:02.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:42:32.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:42:32.520 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:43:02.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:43:02.858 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:43:32.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:43:32.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:44:03.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:44:03.064 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:44:33.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:44:33.186 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:45:03.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:45:03.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:45:33.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:45:33.408 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:46:03.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:46:03.545 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:46:33.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:46:33.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:47:03.859 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:47:03.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:47:33.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:47:34.000 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:48:04.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:48:04.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:48:34.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:48:34.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:49:04.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:49:04.514 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:49:34.574 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:49:34.578 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:50:04.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:50:04.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:50:34.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:50:34.885 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:51:05.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:51:05.023 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:51:35.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:51:35.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:52:05.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:52:05.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:52:35.306 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:52:35.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:53:05.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:53:05.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:53:35.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:53:35.507 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:54:05.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:54:05.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:54:35.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:54:35.770 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:55:05.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:55:05.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:55:35.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:55:35.927 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:56:05.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:56:05.991 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:56:36.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:56:36.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:57:06.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:57:06.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:57:36.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:57:36.287 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:58:06.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:58:06.442 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:58:36.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:58:36.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:59:06.719 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:59:06.722 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:59:36.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T07:59:36.878 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:00:06.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:00:07.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:00:37.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:00:37.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:01:07.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:01:07.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:01:37.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:01:37.422 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:02:07.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:02:07.586 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:02:37.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:02:37.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:03:07.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:03:07.952 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:03:38.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:03:38.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:04:08.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:04:08.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:04:38.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:04:38.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:05:08.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:05:08.514 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:05:38.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:05:38.663 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:06:08.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:06:08.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:06:38.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:06:38.894 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:07:08.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:07:08.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:07:39.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:07:39.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:08:09.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:08:09.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:08:39.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:08:39.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:09:09.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:09:09.443 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:09:39.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:09:39.575 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:10:09.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:10:09.698 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:10:39.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:10:39.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:11:09.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:11:09.861 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:11:39.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:11:39.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:12:10.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:12:10.175 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:12:40.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:12:40.313 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:13:10.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:13:10.472 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:13:40.548 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:13:40.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:14:10.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:14:10.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:14:40.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:14:40.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:15:10.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:15:10.928 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:15:41.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:15:41.071 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:16:11.215 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:16:11.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:16:41.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:16:41.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:17:11.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:17:11.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:17:41.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:17:41.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:18:11.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:18:11.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:18:41.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:18:41.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:19:11.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:19:11.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:19:42.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:19:42.097 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:20:12.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:20:12.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:20:42.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:20:42.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:21:12.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:21:12.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:21:42.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:21:42.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:22:12.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:22:12.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:22:42.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:22:42.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:23:12.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:23:12.953 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:23:43.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:23:43.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:24:13.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:24:13.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:24:43.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:24:43.336 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:25:13.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:25:13.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:25:43.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:25:43.625 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:26:13.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:26:13.764 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:26:43.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:26:43.919 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:27:13.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:27:13.982 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:27:44.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:27:44.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:28:14.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:28:14.247 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:28:44.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:28:44.329 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:29:14.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:29:14.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:29:44.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:29:44.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:30:14.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:30:14.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:30:44.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:30:44.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:31:14.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:31:14.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:31:45.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:31:45.076 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:32:15.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:32:15.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:32:45.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:32:45.297 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:33:15.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:33:15.437 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:33:45.507 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:33:45.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:34:15.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:34:15.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:34:45.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:34:45.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:35:15.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:35:15.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:35:46.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:35:46.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:36:16.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:36:16.079 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:36:46.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:36:46.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:37:16.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:37:16.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:37:46.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:37:46.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:38:16.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:38:16.458 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:38:46.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:38:46.529 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:39:16.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:39:16.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:39:46.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:39:46.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:40:16.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:40:17.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:40:47.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:40:47.103 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:41:17.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:41:17.248 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:41:47.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:41:47.322 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:42:17.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:42:17.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:42:47.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:42:47.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:43:17.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:43:17.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:43:48.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:43:48.024 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:44:18.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:44:18.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:44:48.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:44:48.272 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:45:18.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:45:18.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:45:48.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:45:48.575 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:46:18.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:46:18.716 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:46:48.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:46:48.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:47:18.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:47:18.961 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:47:49.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:47:49.126 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:48:19.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:48:19.275 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:48:49.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:48:49.399 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:49:19.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:49:19.546 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:49:49.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:49:49.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:50:19.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:50:19.685 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:50:49.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:50:49.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:51:19.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:51:19.956 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:51:50.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:51:50.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:52:20.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:52:20.254 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:52:50.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:52:50.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:53:20.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:53:20.524 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:53:50.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:53:50.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:54:20.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:54:20.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:54:50.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:54:50.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:55:20.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:55:20.982 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:55:51.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:55:51.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:56:21.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:56:21.254 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:56:51.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:56:51.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:57:21.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:57:21.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:57:51.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:57:51.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:58:21.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:58:21.684 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:58:51.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:58:51.836 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:59:21.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:59:21.975 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:59:52.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T08:59:52.122 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:00:22.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:00:22.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:00:52.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:00:52.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:01:22.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:01:22.528 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:01:52.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:01:52.693 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:02:22.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:02:22.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:02:52.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:02:52.992 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:03:23.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:03:23.115 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:03:53.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:03:53.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:04:23.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:04:23.408 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:04:53.560 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:04:53.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:05:23.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:05:23.645 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:05:53.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:05:53.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:06:23.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:06:23.932 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:06:54.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:06:54.081 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:07:24.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:07:24.242 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:07:54.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:07:54.393 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:08:24.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:08:24.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:08:54.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:08:54.752 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:09:24.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:09:24.914 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:09:55.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:09:55.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:10:25.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:10:25.186 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:10:55.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:10:55.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:11:25.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:11:25.479 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:11:55.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:11:55.642 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:12:25.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:12:25.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:12:55.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:12:55.885 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:13:26.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:13:26.008 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:13:56.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:13:56.165 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:14:26.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:14:26.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:14:56.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:14:56.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:15:26.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:15:26.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:15:56.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:15:56.687 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:16:26.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:16:26.806 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:16:56.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:16:56.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:17:27.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:17:27.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:17:57.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:17:57.133 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:18:27.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:18:27.248 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:18:57.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:18:57.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:19:27.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:19:27.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:19:57.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:19:57.677 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:20:27.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:20:27.741 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:20:57.868 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:20:57.872 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:21:27.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:21:27.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:21:58.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:21:58.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:22:28.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:22:28.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:22:58.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:22:58.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:23:28.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:23:28.479 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:23:58.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:23:58.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:24:28.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:24:28.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:24:58.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:24:58.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:25:28.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:25:28.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:25:59.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:25:59.093 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:26:29.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:26:29.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:26:59.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:26:59.341 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:27:29.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:27:29.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:27:59.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:27:59.588 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:28:29.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:28:29.736 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:28:59.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:28:59.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:29:30.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:29:30.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:30:00.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:30:00.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:30:30.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:30:30.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:31:00.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:31:00.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:31:30.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:31:30.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:32:00.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:32:00.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:32:30.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:32:30.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:33:00.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:33:00.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:33:31.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:33:31.131 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:34:01.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:34:01.282 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:34:31.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:34:31.423 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:35:01.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:35:01.561 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:35:31.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:35:31.683 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:36:01.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:36:01.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:36:32.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:36:32.016 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:37:02.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:37:02.147 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:37:32.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:37:32.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:38:02.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:38:02.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:38:32.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:38:32.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:39:02.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:39:02.750 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:39:32.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:39:32.887 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:40:03.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:40:03.151 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:40:33.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:40:33.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:41:03.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:41:03.349 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:41:33.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:41:33.505 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:42:03.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:42:03.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:42:33.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:42:33.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:43:03.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:43:03.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:43:34.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:43:34.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:44:04.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:44:04.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:44:34.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:44:34.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:45:04.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:45:04.546 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:45:34.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:45:34.800 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:46:04.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:46:04.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:46:35.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:46:35.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:47:05.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:47:05.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:47:35.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:47:35.301 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:48:05.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:48:05.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:48:35.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:48:35.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:49:05.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:49:05.808 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:49:35.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:49:35.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:50:05.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:50:05.955 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:50:36.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:50:36.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:51:06.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:51:06.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:51:36.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:51:36.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:52:06.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:52:06.226 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:52:36.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:52:36.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:53:06.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:53:06.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:53:36.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:53:36.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:54:06.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:54:06.507 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:54:36.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:54:36.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:55:06.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:55:06.764 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:55:36.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:55:36.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:56:07.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:56:07.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:56:37.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:56:37.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:57:07.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:57:07.288 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:57:37.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:57:37.443 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:58:07.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:58:07.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:58:37.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:58:37.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:59:07.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:59:07.871 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:59:38.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T09:59:38.015 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:00:08.178 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:00:08.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:00:38.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:00:38.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:01:08.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:01:08.432 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:01:38.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:01:38.564 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:02:08.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:02:08.716 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:02:38.868 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:02:38.870 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:03:09.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:03:09.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:03:39.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:03:39.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:04:09.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:04:09.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:04:39.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:04:39.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:05:09.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:05:09.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:05:39.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:05:39.675 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:06:09.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:06:09.836 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:06:39.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:06:39.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:07:10.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:07:10.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:07:40.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:07:40.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:08:10.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:08:10.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:08:40.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:08:40.507 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:09:10.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:09:10.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:09:40.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:09:40.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:10:10.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:10:10.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:10:41.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:10:41.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:11:11.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:11:11.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:11:41.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:11:41.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:12:11.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:12:11.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:12:41.739 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:12:41.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:13:11.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:13:11.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:13:41.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:13:41.922 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:14:12.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:14:12.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:14:42.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:14:42.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:15:12.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:15:12.165 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:15:42.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:15:42.271 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:16:12.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:16:12.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:16:42.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:16:42.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:17:12.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:17:12.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:17:42.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:17:42.824 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:18:12.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:18:12.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:18:43.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:18:43.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:19:13.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:19:13.203 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:19:43.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:19:43.308 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:20:13.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:20:13.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:20:43.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:20:43.547 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:21:13.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:21:13.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:21:43.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:21:43.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:22:13.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:22:13.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:22:44.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:22:44.089 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:23:14.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:23:14.237 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:23:44.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:23:44.370 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:24:14.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:24:14.455 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:24:44.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:24:44.536 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:25:14.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:25:14.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:25:44.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:25:44.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:26:14.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:26:14.739 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:26:44.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:26:44.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:27:14.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:27:14.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:27:44.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:27:44.947 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:28:14.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:28:15.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:28:45.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:28:45.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:29:15.136 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:29:15.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:29:45.210 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:29:45.214 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:30:15.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:30:15.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:30:45.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:30:45.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:31:15.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:31:15.399 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:31:45.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:31:45.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:32:15.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:32:15.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:32:45.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:32:45.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:33:15.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:33:15.835 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:33:45.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:33:45.966 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:34:16.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:34:16.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:34:46.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:34:46.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:35:16.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:35:16.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:35:46.251 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:35:46.254 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:36:16.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:36:16.332 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:36:46.394 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:36:46.398 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:37:16.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:37:16.529 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:37:46.657 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:37:46.660 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:38:16.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:38:16.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:38:46.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:38:46.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:39:16.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:39:16.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:39:47.139 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:39:47.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:40:17.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:40:17.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:40:47.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:40:47.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:41:17.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:41:17.597 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:41:47.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:41:47.750 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:42:17.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:42:17.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:42:48.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:42:48.062 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:43:18.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:43:18.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:43:48.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:43:48.346 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:44:18.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:44:18.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:44:48.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:44:48.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:45:18.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:45:18.801 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:45:48.944 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:45:48.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:46:19.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:46:19.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:46:49.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:46:49.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:47:19.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:47:19.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:47:49.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:47:49.617 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:48:19.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:48:19.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:48:49.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:48:49.884 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:49:19.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:49:19.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:49:50.139 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:49:50.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:50:20.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:50:20.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:50:50.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:50:50.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:51:20.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:51:20.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:51:50.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:51:50.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:52:20.686 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:52:20.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:52:50.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:52:50.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:53:20.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:53:20.844 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:53:50.905 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:53:50.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:54:20.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:54:20.977 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:54:51.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:54:51.062 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:55:21.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:55:21.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:55:51.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:55:51.224 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:56:21.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:56:21.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:56:51.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:56:51.346 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:57:21.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:57:21.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:57:51.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:57:51.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:58:21.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:58:21.566 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:58:51.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:58:51.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:59:21.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:59:21.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:59:51.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T10:59:51.768 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:00:21.827 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:00:21.831 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:00:51.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:00:51.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:01:21.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:01:21.973 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:01:52.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:01:52.045 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:02:22.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:02:22.107 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:02:52.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:02:52.171 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:03:22.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:03:22.359 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:03:52.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:03:52.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:04:22.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:04:22.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:04:52.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:04:52.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:05:22.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:05:22.912 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:05:53.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:05:53.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:06:23.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:06:23.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:06:53.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:06:53.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:07:23.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:07:23.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:07:53.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:07:53.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:08:23.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:08:23.378 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:08:53.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:08:53.449 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:09:23.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:09:23.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:09:53.632 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:09:53.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:10:23.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:10:23.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:10:53.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:10:53.956 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:11:24.119 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:11:24.123 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:11:54.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:11:54.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:12:24.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:12:24.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:12:54.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:12:54.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:13:24.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:13:24.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:13:54.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:13:54.777 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:14:24.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:14:24.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:14:55.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:14:55.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:15:25.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:15:25.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:15:55.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:15:55.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:16:25.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:16:25.476 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:16:55.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:16:55.677 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:17:25.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:17:25.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:17:56.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:17:56.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:18:26.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:18:26.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:18:56.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:18:56.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:19:26.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:19:26.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:19:56.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:19:56.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:20:26.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:20:26.781 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:20:56.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:20:56.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:21:27.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:21:27.070 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:21:57.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:21:57.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:22:27.364 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:22:27.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:22:57.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:22:57.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:23:27.676 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:23:27.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:23:57.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:23:57.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:24:27.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:24:27.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:24:58.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:24:58.109 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:25:28.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:25:28.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:25:58.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:25:58.323 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:26:28.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:26:28.480 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:26:58.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:26:58.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:27:28.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:27:28.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:27:58.827 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:27:58.830 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:28:28.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:28:28.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:28:59.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:28:59.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:29:29.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:29:29.174 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:29:59.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:29:59.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:30:29.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:30:29.327 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:30:59.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:30:59.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:31:29.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:31:29.619 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:31:59.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:31:59.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:32:29.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:32:29.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:32:59.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:32:59.872 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:33:29.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:33:29.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:34:00.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:34:00.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:34:30.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:34:30.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:35:00.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:35:00.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:35:30.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:35:30.214 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:36:00.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:36:00.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:36:30.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:36:30.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:37:00.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:37:00.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:37:30.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:37:30.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:38:00.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:38:00.537 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:38:30.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:38:30.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:39:00.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:39:00.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:39:30.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:39:30.806 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:40:00.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:40:00.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:40:31.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:40:31.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:41:01.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:41:01.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:41:31.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:41:31.392 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:42:01.452 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:42:01.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:42:31.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:42:31.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:43:01.699 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:43:01.703 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:43:31.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:43:31.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:44:01.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:44:01.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:44:32.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:44:32.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:45:02.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:45:02.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:45:32.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:45:32.381 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:46:02.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:46:02.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:46:32.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:46:32.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:47:02.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:47:02.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:47:32.872 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:47:32.875 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:48:02.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:48:02.998 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:48:33.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:48:33.144 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:49:03.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:49:03.282 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:49:33.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:49:33.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:50:03.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:50:03.461 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:50:33.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:50:33.520 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:51:03.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:51:03.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:51:33.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:51:33.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:52:03.739 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:52:03.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:52:33.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:52:33.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:53:03.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:53:03.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:53:34.182 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:53:34.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:54:04.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:54:04.276 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:54:34.411 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:54:34.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:55:04.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:55:04.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:55:34.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:55:34.586 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:56:04.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:56:04.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:56:34.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:56:34.884 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:57:05.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:57:05.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:57:35.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:57:35.182 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:58:05.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:58:05.302 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:58:35.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:58:35.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:59:05.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:59:05.516 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:59:35.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T11:59:35.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:00:05.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:00:05.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:00:35.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:00:35.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:01:05.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:01:05.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:01:35.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:01:35.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:02:06.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:02:06.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:02:36.136 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:02:36.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:03:06.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:03:06.272 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:03:36.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:03:36.341 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:04:06.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:04:06.469 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:04:36.606 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:04:36.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:05:06.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:05:06.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:05:36.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:05:36.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:06:06.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:06:06.920 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:06:36.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:06:37.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:07:07.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:07:07.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:07:37.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:07:37.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:08:07.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:08:07.324 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:08:37.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:08:37.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:09:07.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:09:07.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:09:37.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:09:37.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:10:07.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:10:07.744 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:10:37.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:10:37.884 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:11:08.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:11:08.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:11:38.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:11:38.088 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:12:08.210 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:12:08.213 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:12:38.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:12:38.353 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:13:08.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:13:08.524 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:13:38.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:13:38.617 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T12:13:53.053 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-08-31T12:13:53.054 DEBUG:teuthology.task.console_log:Killing console logger for smithi077 2023-08-31T12:13:53.055 DEBUG:teuthology.task.console_log:Killing console logger for smithi139 2023-08-31T12:13:53.055 DEBUG:teuthology.exit:Finished running handlers